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Abstract 

We propose a model for the frequency of an altruistic defense trait. More precisely, we consider Lotka- 
Volterra-type models involving a host/prey population consisting of two types and a parasite/predator 
population where one type of host individuals (modeling carriers of a defense trait) is more effective in 
defending against the parasite but has a weak reproductive disadvantage. Under certain assumptions we 
prove that the relative frequency of these altruistic individuals in the total host population converges to 
spatially structured Wright-Fisher diffusions with frequency-dependent migration rates. For the many- 
demes limit (mean-field approximation) hereof, we show that the defense trait goes to fixation/extinction 
if and only if the selective disadvantage is smaller/larger than an explicit function of the ecological model 
parameters. 
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1 Introduction 


Altruism refers to the behavior of an individual that decreases the reproductive success of the actor while 
increasing the reproductive success of one or more recipients. In most natural systems, non-altruistic individuals 
benefit from altruistic individuals without suffering from the fitness disadvantage and, thus, have a direct 
reproductive advantage. So how can genetically inherited selfless behavior be explained by natural selection? 
This problem has bothered biologists since Charles Darwin who reflected the puzzle of sterile social insects such 
as the worker castes of ants in his famous book “The Origin of Species” [5] . 

In the biology and game theory literature there exist several explanations for the emergence of altruism (also 
referred to as cooperation in game theory). The central idea behind kin selection is that helping direct relatives 
benefits the reproductive success of the altruists’ genes. This idea is formalized in Hamilton’s rule which states 
that traits increase in frequency \i R - B > C where R is the genetic relatedness of the recipient and the actor, 
B is the additional reproductive benefit gained by the recipient, and C is the reproductive cost to the actor; see 
Hamilton [13]. Relatedness is frequently defined as the probability of sharing the same allele by descent, e.g., 
1/2 for two sisters and 1/8 for two cousins. However, general applicability of Hamilton’s rule is controversial; 
e.g., the paper by Nowak et al. [17] provoked a strong response including a rebuttal from 137 researchers [I]. 
Another explanation for the emergence of altruistic behavior is the intensively debated theory of group selection; 
see, e.g., Wade m and Queller m- The central idea is that groups of cooperators grow faster and, therefore, 
split earlier or into more groups than groups of defectors; see, e.g., the haystack model of Maynard Smith [23] or 
Traulsen and Nowak m- The importance of group selection (or more generally multilevel selection) in evolution 
remains controversial; cf., e.g., Maynard Smith [H], Goodnight and Stevens m. Goodnight and Wade m, 
Traulsen [36] , and Gardner [3] . Further game theoretic explanations for the emergence of cooperative behavior 
include direct reciprocity with the repeated Prisoner’s Dilemma as a prominent example, indirect reciprocity, 
and network reciprocity. Reciprocity has also been observed in a number of animal taxa; see, e.g., Bshary and 
Grutter [3] or McGregor [^. For comparative reviews of the above mentioned explanations, from different 
perspectives, see Nowak [75] and West et al. [H]. Moreover a number of recent papers propose spatially 
distributed predator-prey (or host-parasite) models and study these models via computer simulations; see, e.g., 
Gommins et al. [3], Rand et al. m, Haraguchi and Sasaki [H, Rauch et al. EiEa, Goodnight et al. m, Best 
et al. [2], and the references therein. In these models (except for Gomins et al. [4]), points in a lattice change 
between the states “susceptible”, “infected”, and “unoccupied” according to probabilities that depend on the 
states of the neighboring lattice points. 

In this article we focus on the important scenario of defense against a parasite or predator. Examples of such 
a scenario include self-sacrificial colony defense in social insects (see Shorter and Rueppell [35] for a review), 
suicidal defense of bacteria against pathogen infection (see Fukuyo et al. 0), and slave rebellion in ants (see 
Pamminger et al. [28]). Clearly, close relatives of altruists are likely to live in the immediate vicinity and benefit 
from the altruists which increases the inclusive fitness of defense traits. However, Hamilton’s rule is difficult to 
apply if the relative frequency of related recipients is unknown. The theory of group selection contributes the 
qualitative explanation that demes with many altruists have a larger carrying capacity and, thereby, support 
more successful emigration events. However, it is difficult to calculate the selective advantage of a deme without 
knowing the local relative frequencies of altruists. So to get a quantitative model for altruistic defense against 
parasites, we will derive as our main contribution. Theorem 11.31 below, the dynamics of the local frequencies 
of altruists. In our model we only incorporate kin selection or group selection implicitly. In particular, we 
do not assume that altruists specifically favor close relatives or that competition among groups occurs within 
a few generations as in most of the traditional models on group selection; cf., e.g., Maynard Smith m and 
van Valen [38] . Instead, we begin with standard spatial host-parasite models (or, equivalently, with spatial 
predator-prey models) with a host population consisting of two types and a parasite population. One type of 
host individuals behaves altruistically in the sense that it has a reduced growth rate but also contributes less 
to the growth of the parasite population. So we do not incorporate the defense mechanism itself in our model 
but only its effect of reducing the per capita growth rate of the parasite population. 

1.1 Main results 

We begin with a stochastic extension of the classical and long-established Lotka-Volterra model (see Lotka [77] 
and Volterra [39] 1 which can be obtained as an approximation of discrete Markov chains such as renormalized 
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two-types birth and death processes in the case of large populations. To formulate these stochastic extensions, 
we consider the following setting (see Section 11.21 for notational conventions used throughout this article). 
Let P) be a probability space, let V be an at most countable set (the set of demes) and let m € 

[ 0 ,oo)^^^ satisfy for every i G V that ~ Sfcex> refer to m as the migration 

matrix or matrix of migration rates. Let X, p G (0,oo) satisfy p < rj. For every iV G N, let 


K^, Kp,a^, (3p , ip € [0,oo), let {i),W‘^'^{i),W^'^(i): [0,oo) x ft ^ R, i G V, he independent 

Brownian motions with continuous sample paths, let ,C^, : [0, oo) x 2? x —>■ [0, oo) be adapted processes 

with continuous sample paths that for all t G [0,oo) and all i G V satisfy P-a.s. 
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+ f P^(x) [-y - iPs^i^ + vCf{i) + {p- p)A^{i)] +i^ds+ f Jp^P,^{i)dWP^{i), 

JO Jo ^ 

let : [0,oo) x P x fl —>• [0,oo) satisfy P[^ = A^ + , and let : [0, oo) x P x —>• [0,1] satisfy 

= -^^ 57 -. For every G N, the process F[^ describes the host (or prey) populations, A^ describes the 
altruists (or cooperators), describes the cheaters (or defectors), and P^ describes the parasite (or predator) 
populations, each measured in units of N individuals. Existence of solutions to m, which we assume here, can 
be established in suitable Liggett-Spitzer spaces if P is an Abelian group and if m is translation invariant and 
irreducible; cf. Proposition 2.1 in m- 

The central goal of this article is to prove convergence of the sequence )tg[o,oo))AfgN and to derive 

the diffusion equation which the limit solves. In other words, we will derive an analog of the Kimura stepping 
stone model (i.e., spatially structured Wright-Fisher diffusions) for altruistic defense against parasites. Since 
A^, , P^ are measured in units of N individuals and the stochastic fluctuations scale with JN as A^ —>■ oo, 

we need to assume that fdp and /3p are of order for large A^ G N. To get a nontrivial diffusion approximation 
we additionally assume - as is usual in the derivation of the Kimura stepping stone model - slow migration 
and weak selection in the sense that the sequences {NKp)Nen, (A^Kp)ArGN and {Na^)Nen converge. Thus the 

A 

relative frequency of altruists ^Aip^jv evolves on the time scale of order N as N 

In the special case that for some A^ G N it holds that Kp = Kp = tp = tp = = Ph = Pp — 

A^ = 0 and (H^(i), P^(i)), i gV, satisfy classical Lotka-Volterra equations. It is well known that if Kp > p, 


N _ „,N _ pN _ qN _ J^N _ then 


then the solutions of these equations converge to the nontrivial equilibrium ( \^KSrj ^ x-y+sx '^ ) ^ each 

are of order o(l) as N —t oo and since the altruist 


Since we assume that Kp,Kp,a ^,6 


N 


N oN 


.P\ 


N 


H^Pp 


deme. 

frequencies evolve slowly, for every i G P, the processes {H^{i), P^{i)) should asymptotically be close to the 
equilibrium of the classical Lotka-Volterra equations with 77 being replaced by 77 — pF^ {i) as V —>■ 00 . More 
precisely, we will prove in Theorem 11.21 below under further assumptions that if the local frequency of altruists 
is g G [0,1], then the equilibrium state for hosts and parasites should be {hooiq)-,Pooiq)) where the functions 
hoo and Poo are defined by 


[0,1] 9 a; I—>■ he 


_ K{5i'+'y\) 

J ’ X-y-\-6K{r)—px) 
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G (0, 00 ) 
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and where a := and b := 


Si>-\-X'y ■ 


Kb{a—x) ^ 

For these functions to be well defined we will assume that Kb{a—1) > 1 
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or, equivalently, that K{r] — p) > v. 

The above heuristic is incorrect if all populations go extinct by chance due to stochasticity in the offspring 
distributions. To avoid this difficulty we will assume that there is sufficient immigration of hosts (2t;^ > /3^) 
and parasites (2tp > in order that both host populations and parasite populations cannot go extinct; 
see Lemmas and 12.31 respectively. However, note that both altruists and cheaters can locally die out. For 
our proof, which is based on the Lyapunov function dlzl), we additionally require further restrictions on the 
parameters and on (inverse) moments of the initial configuration. 
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Assumption 1.1. In the setting of the first paragraph of Section \l.l\ it holds that X> v, p — p > ^ > 25, 

for all N G N it holds that a 

and there exist a = {(7i)i^'D € (0, oo) 
holds that 


Op ^ 


oN 


and c € (0,oo) such that ^ such that for every j € V it 

crj) < c(Tj, (3) 




r / \ 4 pN 

and such that sup^y^N®" “f ) “f 


pN 


< oo. 


The following theorem, which appears to be new even for non-spatial stochastic Lotka-Volterra stochastic dif¬ 
ferential equations (SDEs), proves for every t G [0, oo) that the L^([0, t] x 1), x H; R)-distance between (iL.^, P.%) 
and {hoo{F.%),Poo{F.%)) converges to 0 as iV —>• oo at least with rate Theorem ll. 21 follows immediately from 
Theorem 12.81 below together with a time substitution. 


Theorem 1.2. Assume the setting of the first paragraph of Section M.ll let Assumvtion \ 1. 1\ hold, assume that 
sup^gj^(A^max{Kp, Kp, Qf^, tp, 6p,/3^,/3p }) < oo and let hao and p^o be given by ([2]). Then we get for all sets 
T> QT) and all t G [0, oo) that 


sup N [ E 

iVeN Jo 


'll cr* {Hun{^ - hoo {PuNii) 

icb i£T> 


Poo {F^Nii))I 


du < oo. 


(4) 


Knowing the asymptotic behavior of the host populations, we can formally replace the (iL^)ArgN in the 
diffusion equation (fTlTll of the altruist frequencies and, thereby, we arrive at the diffusion equation which the 
limit of altruist frequencies solves. Our main result. Theorem 11.31 then proves that the altruist frequencies 
converge to the solution of the diffusion equation ([5]) . The proof of Theorem 11.31 is deferred to Section 12.4.21 
below and is based on a general stochastic averaging result in Kurtz m- 


Theorem 1.3. Assume the setting of the first paragraph of Section \l.ll let Assumvtion 11.11 hold, assume that 
supjvgN CTiE FIq ii) < oo, that sup ma.x{Kp, Lp, fip}) < oo, that there exist K,a,P G [0,oo) 

= K, \imNao ct^N = a and hmjv_ 

N ^ oo in If. Then the SDE 


such that limjv_>oo KpiV = k, \im noo ct^ N = a and \imN-,.ao P^Nb = (3 and assume that => Xq as 


dXfii) =K ^ m{i,j) - -’^t(j)) dt - aXfiifil - Xt{i))dt 

J6I> (5) 

-f yjj3[a - Xt{i))Xt{i){l - Xt{i)) dWt{i), t G {0,oo),i G V 


(where {W{i) \ i G T)} are independent standard Brownian motions) has a unique strong solution and 

W)tG[ 0 ,oo) ^ (^‘),G[ 0 .oo) ( 6 ) 

as N ^ OO in (^([O, oo),/,).). 

An important problem is to derive conditions under which altruists persist, that is, to derive conditions on the 
parameters of the SDE (0 under which the process goes to fixation. Here we simplify this problem and consider 
the many-demes-limit (also denoted as mean-field approximation) of the SDE ([SI). More precisely, for every 
D gN, let X^ : [0, oo) x{l,... ,D}xD —>■ [0,1] be the solution of the SDE (O with V replaced by {1,..., D} and 
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with m replaced by We will show in ProDOsition l3. II together with Lemma 13.21 below that if, 

for every D G N, £)} are exchangeable [0, l]-valued random variables, if sup^gpj ]E[(X,P(1))^] < oo, 

if Z : [0, oo) X —>■ [0,1] is the solution of the SDE ([5]) below with respect to the Brownian motion W (1) and if 
sup£)gf^ a/ZJE [|X,P(i) — 2o(*)|] < oo, then for all t G [0,oo) it holds that 

sup /DE [\Xt^{l) - Zt\\ < oo. (7) 

DSN 


Thus the solution of the SDE (jS]) is the many-demes limit of the SDE ([5]). For this many-demes limit we derive 
a simple necessary and sufficient condition (a < /?) under which the altruistic defense trait goes to fixation 
when starting with a positive frequency. The proof of Theorem ll.dl is deferred to Section |T3l 

Theorem 1.4. Let q;,/3,k G (0,oo), let a G (l,oo), let (D, 7^, P, « filtered probability space, 

let W: [0,oo) x D —>■ K 6e a standard {iFt)te[o,oo) Brownian motion with continuous sample paths, and let 
Zq: n ^ [0,1] be an J^o/B([0, V\)-measurable mapping. Then the SDE 


dZt = K(a - Zt) ((a - Zt)E - l) dt - aZt (1 - Zt) dt + P{a - Zt)Zt{l - Zt) dWt 


( 8 ) 


has a unique solution. Furthermore, i/E[Zo] = 1, then P[^t = 1 for all t G [0,oo)] 
P[Zt = 0 for all t G [0,oo)] = 1 and j/E[Zo] G (0,1), then 

lim E[|Zt — oil =0, if a > f, 

lim E[|Zt — ill =0, if a < 

Zt [m{z) dz, if a = f, 


1, if E[Zo] = 0, then 


(9) 


where m{z) = ^z ^(1 — z) — z) ^ for z G (0,1), where c G (0, oo) is a normalizing 

constant and where 9 = E[ ^_^^^ ]. 

Informally speaking. Theorem 11.41 asserts that an altruistic defense allele persists in an infinite dimensional 
space if a < /3 and if the mean frequency of altruists over all demes is positive. This does not imply that a new 
mutation resulting in altruistic defense behavior can establish itself on one island or even in the total population. 
Our final result partially closes this gap and considers a process which could be the limit lim£)_>oo 
if for all D G N and i G {!,..., D} it holds that X^{i) = Toli=i for some [0, l]-valued random variable; 
cf. Hutzenthaler [15], [16]. For this limiting process. Proposition 15.11 below shows in the case P[Fo > 0] = 
1 that the process converges to 0 in probability as time goes to infinity if and only ii a > f. Informally 
speaking, Proposition 15.11 asserts that an altruistic defense allele has a positive invasion probability in an 
infinite dimensional space if and only ii a < f. 


1.2 Notation 

Throughout this article, we will use the following notation. We dehne [0,oo] := [0,oo) U {oo}. We will use the 
conventions that 0° = 1, 0• oo = 0, and that for any x G (0, oo) we have that ^ = 0 and | = oo. For all x,y gR 
we define x'^ := max{x,0}, sgn(a;) := lx>o ~ la:< 0 i and x A y := minja;,?/}. We define sup(0) := —oo and 
inf(0) := oo. For a topological space {E,£) we denote by B{E) the Borel sigma-algebra of {E,£). Moreover we 
agree on the convention that zero times an undefined expression is set to zero. For every countable set D and 
every a = {ai)i^T> G (0, oo)^ define a function || • [0,oo] by K® 9 z = {zi)^(zv \\z\\a := Sie-D 

and define l], := {z G : \\z\\a- < oo}. 


2 Convergence of the relative frequency of altruists 

2.1 Setting 

Assume the setting of the first paragraph of Section [TTI Define Rh ■= k^, Rp := sup^y^j^Kp, fp ■= 

supjvgN/3p, Pp := supjv£N/3pi := sup^gpj''p: := sup^ygNtp, and fp ■= limAr_>oo/3p • For all z = 
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{zi)i^v S (0, oo)® and p G R let Furthermore, let 1 := G Define Ei := [0,1]^ and 

E 2 := n [0, 00)^. For alH G D and all G N let (i): [0, 00) x id —>■ R and (i): [0, 00) x D —>■ R 

be stochastic processes with continuous sample paths such that for every t G [0, 00) it holds P-a.s. that 



dWF^{ 


(10) 

and 

dWf’^ii 

’ y/HT(i) 

(11) 

respectively, with {i 

) = wF^ii) = 

0. 



2.2 Preliminaries 

Assume the setting of Section [^?T] In this section we collect some first results that are used in the proofs of the 
statements in subsequent sections. 

Lemma 2 . 1 . Assume the setting of Section \ 2 . 1 \ Then and N G N, i G V, are independent 

Brownian motions and for all t G [0,oo), all i GT), and all N gN it P-a.s. holds that 


( 12 ) 


(13) 


(*) = H^i^) + [ + (A - E^{{))Hs {i) - ^ (*))' 

•^0 jgx) 

- 5P^{i)Hsi3) + i’^rds + (*) dlFf’^(*), 

= F^ii) + f ^(^^3) {F^U) “ (*)) ip^ “ a^F^{i) (l - F^{i)) ds 

do 

P,^(*) = j)^f O’) - i^P + - 7 (Df (*))' + {v- pFf (*)) Pf (*)i7f (*) (14) 

do jg-p 

+ 4 ds + ^/3^Pf(*) dwF^ii). 

Proof For all t G [0, 00 ), all iV G N, and alH G P we get (W^’^(i))^ = {W^’^(i))^ = t as well as 




(15) 


Hence, we see that W^’^{i) and W^’^{i), N G N, i G V, are independent Brownian motions. Equation m 
follows from Ito’s lemma (e.g., Klenke CD) and rearranging terms. Furthermore, applying Ito’s lemma we see 
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for all t G [0, oo), all i G T>, and all G N that P-a.s. it holds that 


(0 =^o^(*) + f X! i^s U) - (*)) + (*)(-^ (l - - a^) 


,N Af(i) 

^WF) 




je-D 




f T§f 7 i J) (^ (i - ^) - 

*^0 \ ./--n 


+ j - X - I W^^nA^i^) + j^^PnCfii) ds 

=F^{^ + It^T. ((1 - (*) (1 - (J)) (J)) 


rt 


( 16 ) 




g.r(d pjv /lAf/ 


Af(d aNr^Ni 




- a^Ff (*) (1 - Ff (* 


and (ITSl) follows. Finally, we obtain (ITil) from the definition of (F^^)^gnj and (F^) 


/AfGN' 


□ 


Lemma 2.2. Assume the setting of Section \ 2. 1\ and assume that for all N G N we have > -^Ph ■ Furthermore, 
assume that we have for all N G N and all i GP that P-a.s. (i) > 0. Then we have 


[H:^(i) > 0, for all u G [0, oo), all N gN, and all i GV] =1. 


(17) 


Proof. For every N,M G N let : [0, oo) x F x 11 —>■ [0, oo) be an adapted process with continuous sample 

paths that for all t G [0,oo) and alH G F satisfies P-a.s. 


Ht (0 = ^0 W + 


/o 


(a - a" - kS - Ah"'"!;) - -sm) + iS 

+ [‘ Fs6rF)dw«-'^{i) 

Jo 


ds 


(18) 


with H^’^{i) = Hq {i). Due to Feller’s boundary classification (e.g., p. 366 in Ethier and Kurtz [7]) with the 
assumption that for all iV G N it holds that we have for every fV, M G N and all i G F that 


H^’^{i) > 0, for all t G [0,oo) 


= 1 . 


(19) 


For all N,M G N, all i GV, and all t G [0, oo) consider the event A^{i) := < sup P^{i) < M >. We have for 

i«6[o.t] J 

all N,M G N, all i GV, and all t G [0, oo) that 


AUi)QAZ+,[^ 


1 

• 

1_ 

= p 

sup P^{i) < oo 

_mgn 


se[o,t] 


= 1 . 


( 20 ) 


Using a comparison result due to Ikeda and Watanabe (see e.g., Theorem V.43.1 in Rogers and Williams |34) 1. 
we get for all iV, M G N, alH G F , and all t G [0, oo) that 


3n G [0,t] : H^(i) < sup Pf (z) < M 


sGfO.t] 


= 0 . 


( 21 ) 
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Tlius, conibining (|19jl . (j2Qjl . 3 ,nd m we obtain for all iV G N, alH S V, and all t G [0, oo) that 


1 > P > 0, for all u G [0, t]] = 1 — P [3 u G [0, t] : H^{i) = O] 

> 1 - ^ P 3m G [0,t] : H^{i) = 0, sup Pf (z) < M 
Men I s6[o,t] 


>1-^P 

mgn 


3m G [0,t] : sup Pf (z) < M 

sG[0,t] 


= 1 . 


( 22 ) 


This implies for all TV G N, all z G P, and all t G [0, oo) that P [P^(z) > 0, for all u G [0, t]] = 1, which in turn 


implies (ED- This finishes the proof of Lemma 12.21 □ 

Lemma 2.3. Assume the setting of Section \2.1\ and assume that for all N £ H it holds that tp > ■ 

Furthermore, assume that we have for all N G N and all i gTA that P-a.s. (z) > 0. Then we have 

P > 0, for all t G [0, oo), all N G N, and all z G P] =1. (23) 

Proof. Analogous to the proof of Lemma [121 n 

Lemma 2.4. Assume the setting of Section \2.1l For all x = {xi)i^x> G E 2 , all p G [l,oo), and all sets P' C P 
it holds that 

^ < ^ccr.xf. (24) 

iGT)' j^T> i^T> 

Proof. For any x = {xi)i^x> ^ any p G [1, oo), and any set V' ^ T> we obtain from Jensen’s inequality and 

® that j)^^j < Ezec □ 


2.3 Strong convergence of the spatial stochastic Lotka-Volterra processes 

In this section we will show the convergence of the time-rescaled Lotka-Volterra processes as given in m and 
d. In Lemmas 12.5112.61 and 12.71 we will provide bounds for the expected value of the sum (over sets of demes) 
of functionals of the processes weighted by a. These are then used in Theorem 12.81 to show a result on the 
behavior of a spatial analogue of a well-known Lyapunov function (e.g., Dobrinevski and Frey ED- From that 
the convergence of the processes follows immediately in Theorem 11.21 

Lemma 2.5. Assume the setting of Section \2. 1\ and let p G {1} U [2, oo). Then we have 


sup sup E 

( 2 zyijf+ <5Pf)^ 


< sup E 

{2,H,^ + SP,^r 


AfeN tG[0,oo) 


cr. 



( 7 . 



i7 

r 1 A 1 1 \ 

\2r] K’4^S'^ 1 j 

1 


1 + 


\ 


1 -b 




(A-|-(l-i + |)(K/f+Kp)) 


(25) 


Proof. If we assume sup^gp^E [||(P(^-|-Pj^)^||^] = oo, then the claim trivially holds. For the remainder 
of the proof assume suppYgN^I^ ^ Define Pq := 0 and for every rz G N let P„ C P 

be a set with |P„| = min{n, |P|} and P„ 3 P„_i. Define real numbers cq := niin j-yj, ci := 

p [2riLH + Sip + {p-l) {2r]PH + € (0, oo), C 2 := XpF{p-l+c){KH+iip) G (0, oo), C 3 := cqP (Z^fcGC ^k) 

i 

(0,oo), and C 4 := ci {J2keP^k)^ G (0,oo). For all V G N, t G [0,oo) define := 2-qFd^ + and for all 
N,n G'H and all t G [0, 00 ) let be a real-valued random variable such that P-a.s. it holds that 


M, 


N,n 


r2zyp(ry(z))^ ^ JpfH^)dW^’^it) + 
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i£T>n 


Applying Ito’s lemma we get for all N^n gN and all t G [0,cx)) that P-a.s. 

T>n i^T>n 

= y] cr, / 2r]p{Y^{i)Y~^ iK^^m{i,j)HY{j) + {\-KH-a^FY{i))HY{i) 
jGX)„ V jg-d 

- ^ i^)Y - ^PYii)HYii) + 4) + SP (XYii)y ^ f^P XI 


j£T> 


- {k^ + v)PY{i) - 7 {PYiYf + (7 - pP^ii)) PY{i)HY{i) + ip j 

+ \'^p^p{p - 1 ) {YY{i)Y ^ PnHYii) + Wp{p - 1 ) {yYi})Y ^ PpPY{i) du + mY’"". 

Because 1 > co4, > co2r], and 7 > Scq we get for all N,n gN and all t G [0, 00 ) that P-a.s. 


i^T>. 


X Y'Yi^)Y - X (^o^(*))^ 

< X f P{yYi^)Y~" X m{i,3)HY{]) + 2p\HYi^) - c^{2t^hY 

i^T)^ •iO \ jGP 

- [r]6 + co4r]S] + 2pIh] 


+ p{YYi^Y M X "*(*> (j) + (*) - co{6PY{i)Y + p6PY{i)HY{i) + Slp 

V jeP ! 

+ p(p- 1) 77(*))'’■' {2p~^H + Wp) 2pHY{i) + {\5 Pp + 2pBh) 5PYdu + 

= / X ^^pi^YiPtY ^2?7Kff X"^(*’7^7(j) + X ^^pYpY{P)Y ^ 

0 „v- 'n ^- /- -n A/-'T^ 


i^T>n 


j£V 


i^T>n 


^ (r7(*)) - Co 77(*)) + {2r]LH + Sip) 1 + X (ru^(*))^ ^kp m{i,j)PY{j) 

K ) jGP„ JGP 


+ X ^*^’7 “ ( 2 i?^P + \Sl3p) {YY{i)Y ^ du + mY’ 


i^T>n 


Using Young’s inequality and Lemmawe get for all N^n gN and all t G [0,oo) that P-a.s. 

X YpY(^)Y - X {yo^ii)Y 


iCDn 


i€T>n 


- f J2 ^^G^pi^Yii)Y+ Y^4p'^^^Y^^Yii)Y + J2 

iep„ iGP iePn 


+ X {yY{^)Y ^ - X '^^^op{ yY{^)Y^' + X <^iG^pY'Yii)Y'^p 


Af/.xNlP+l 


i€T>n 


i£T>n 


i£Vn 


+ X ^Yp^p^ YPY{i)Y du + mY’'^ 

i^T> 

- [ X^*^2 (r7(*))^+ X c*ci 77(*))^”^ - X c*cop77(*))^^^ su + mY’''' 


i^V 


i^T>n 


i^T>n 


(27) 


( 28 ) 


(29) 


9 


For N,n,l gN define [0,oo]-valued stopping times 


_^N,n g [ 0 ,Oo) ; ^2 {i)Y > ^1 U ■ 


We now get for all iV, n, / £ N and all t £ [0, oo) that 


E 


rtAr 


= E 


E 

i^T>n 

N,; 


‘^VP {YYii)Y ' {YY{i)Y ' YP^P^ii) 


. /fliV 


du 


I 2r?/3^ ^^2r,H^iz)^ + Si^)Y '^/sP^i^)j 


du 


< (277/3^ +(5/3^) E 


ptAr, 


E 


i^Vn 


2 (>;^w) 


du 


Using Young’s inequality, we obtain for all N,n,l £ N and all t £ [0, oo) that 

E'"* {2riP{YY{j^)Y~^ (*))'’■ 


E 


i£T>r 

qN I xgN' 


du 


< (277/3^+<5/3|f)E 

< (2,7/3^+^/3^)E 


ptAr, 


E k(VF" (■))' +i)' 


i€T>n 


du 



r / \ 2 i 

" 

/ E 

/ / ^ mm <7k 

(( 2 p-l) (Yj^^(*))Vl) 

du 


min (7k 
k^T>n 


N,n 


a, {{2p - 1) {Y^{i)Y + l) 


\i&V„ 


< 


-E 


^ 2r,pZ+S0^ ^ 


(2p- 1) ^ a, + Hill. 

\ iG j 

((2 p-i); + ||i|U)^ 


du 


du 


< oo. 


(30) 


(31) 


(32) 


Hence, we get for all N,n,l G N and all t £ [0, oo) that E 
theorem we see for all A^, n, Z £ N and alH £ [0, oo) that 


tAT, 


= 0. From this and and using Tonelli’s 


E 


E-.( 


yN 

tAr, 


.i&TI, 

< E 

< E 


rtAr. 


N,n(*) + 


coP E 

i£T>n 


{yYY 

{yYY 


+ E 






~ 

/ 

{yYY 

+ Cl 

{yYY" 

du 

Jo 

a 

(7 


(33) 


C 2 E 


{yYY 


■ ciE 




N\P-^ 


du. 


For every A^, n £ N the map [0,oo) 9 t 1 —>■ {YY(i)Y £ R is P-a.s. continuous which implies for all 

A^, n £ N and all t £ [0, 00 ) that P limi_>.oo < t =0. From Tonelli’s theorem and monotone convergence, 
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then using Fatou’s lemma, and finally applying (l33ll we see for all TV G N and all t G [0, oo) that 


E 




.i£T> 


= lim E 

n—^oo 


= lim E 

n—^oo 


- [ copE 

Jo 


.i€T> 

E + / cop El du 

ie'D^ "'0 iGX>„ 

,1™ f E (*))'' + / ^0^^ E (*)) 

\ o^'n *^0 


p+1 


du 


( 34 ) 


< lim lim inf E 

n—>-oo /—>-oo 


, . 1\ ,Tl 

/ \ T) ^Ti/\^j 

E +/ COP E 

ieX>„ 


< E 




C2E 


- ciE 




zei> 

Ar\P-i 


du. 


This implies using Jensen’s inequality for all iV G N and all t G [0,oo) that we get 


E 


{vn" 

< f C2E 

Jo 

= [ C 2 E 

Jo 


-E 


[||W)’ 


< / C 2 E 


Eo-i (*))^ 

.i^T) 

.i&'D 


- ciE 




.x\P-l 


.iGT> 


.i£V 

_j_ E!fcgx> j 

Elzex) ' 

+ C 4 ( E 


ciE 


- copE 
Nr-\\P-^ 




.i£T> 

- copE 


Ec-i 

E®"* (Fu^(f)) 


.iev 


du 

AT/.^NP+l 


.iev 


du 


(35) 




.iev 


- C 3 E 


{Yuii)Y 


.iGT> 


P+i 


du 


du. 


= (e [|| (Fj^)''||J ) "" {c4 + C2 (e [|| (F„^)'’||J ) "" - C3 (e [|| (Fj^)'’||J ) ""} 

For every G N let : [0, 00 ) —?► R be a process that for all t G [0, 00 ) satisfies 

Zt ^^0 + (^f) ~ {c4 + C2 (zf) ^ - C3 (zf) ^ I ds 

with Zq = E [II (Fq'^)^II^] , where uniqueness follows from local Lipschitz continuity. Using classical comparison 
results from the theory of ODEs, the above computation shows that for all iV G N and all t G [0, 00 ) we have 

[||(^t^)^L] ^ and for all G N we have suptg[o,oo) = niax|E [||(Fo^)^L] , + \J^ 

We thereby conclude that 


(36) 


sup sup E 

WGN tG[0.oo) 

= sup E 
iVeN 


{2'qH^ + 5P^Y < sup sup < sup E (Fq^)^ 

o-J AfGN tGfO.oo) AfGN L 

(O" 1 + s (1 + 4/1 + ^)" = sup E [ (2,y< + 5P^) 

crJ \ V 2 / L 


C2 

2C3 


4c5 


£4 

C 3 




1 + 


V 


\ 


[2?7i,H+5i.p + (p-l)(|2r;/3H + i4^p|)j 
(A+(l-i + |)(Kp+«;p)) 


(37) 


This finishes the proof of Lemma 12.51 


□ 
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Lemma 2.6. Assume the setting of Section \2.1\ and assume 7 > 2S. Furthermore, assume that for all N G N 
we have < j, i^p < ‘'H — 3 ^f^+A) V FI) be a set. Then we have 


sup sup E 

A^GN [0,oo) 



2 pf w 

(fff (*))" 




(38) 


4:KpC 
3A( A-j-i/*) 


sup sup E 
NeN tefo.oo) 




4 

A(A+!y) 





Proof. If the right-hand side of (1551) is infinite, then the claim trivially holds. For the remainder of the proof 
assume the right-hand side of (1551) to be finite. Define Vq := 0 and for every n G N let T>n FT) he & set with 
\T)n\ = min {n, \'D\] and (D„ F Pn-i- Define ci := and for all n G N let 


Cq := sup sup E 

^ a, {Pfii)f 

+ 2ci 

+ 

1 _ 

sup sup E 


AiGNtGiO.oo) 




ATGN tGfO.oo) 

.iex>„ 


(39) 


For N,n,l gN define [0,oo]-valued stopping times 


N,n 

Tl 



(40) 


We infer from Lemma l2^ that for all N,n G'H the map [0,oo) 9 t >->■ J2ieT>n i^Pt^ i.^) + G K is 

P-a.s. continuous. Thereby, we have for all t G [0, 00 ) and all N,n G N that 


lim ' 

l—>-oo 


N,n 


< t 


= 0 . 


For all t G [0, 00 ), N,n,l G N applying Young’s inequality we get 


and 


E 




rtAr, 


< E 

< 


r, ^/WW(A\ j 


Y (i AAr-of +1 (K..rF>) 


iev, 

t4c^ 0P jp. 


-5 


— min {at} 

fce-D„ 


sup f ^ a, (P^ 

Viei5„ ^ V 1 / 


-1 


< < 00 

— min \Gf\ 

k^-Dn 


E 




< E 


(4ciPA« + |)^^1P) 


< 


< 


.ieT) 
ti4ci + ^)^0H 

t{4ci + ^)^0H 


-7 


E 




f^(^ + l|l||j"<oo. 


(41) 


(42) 


( 43 ) 
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Hence, we obtain for all t G [0, oo) and all N,n,l G N that 


E 


E 


E 

E 

.i£T>n 




= 0 , 


ntAr, 


(4ciP„^(*) + i) dW^’^ii) 


(44) 


= 0 . 


Define the function y. N x N x [0,oo) —>■ [0,oo] by 


N X N X [0, oo) 9 (N, n, t) ^ yf:= E 


^ CTi ( 2C; 


tGl>„ 


(fff (*))" ^ 25 


(45) 


Recall from the beginning of the proof that we assume for all iV, n G N that < oo. Now, applying Ito’s 
lemma and using (l4^ . we obtain for all t G [0, oo) and all TV, n, / G N that 


E 


E 

.ieD„ 

= E 


(^ , 1 1 

\ tAT^ ’ tAT, ' 


‘I 


N,n 

Vo 


E 

ieVn 


aMt, ’ 

CTi / 2ci 




E '^(^A)Pu(.j) - {Kp + v)p^{i) - 7 (H,f (i))' 




+ (77 - pT^„^( 7 )) P„^(*)i?„^(*) + ) - (2ci 


2Af h) , 1 2 


^ 25 (pN) 


0 

V TG-D 


+ {-n^ + A - - ^P„^(*)i?„^(*) + 4j 

+ du . 

Dropping some negative terms, we now get for alH G [0, 00 ) and all TV, n, 1 G N that 


E 


^ CTz 2 cip^ 




.iGl>„ 


< E 


^ 25 „„W)" 

tAT, tAT, 


E / (fffw ( E ^AA)Puij) - '^Puii) - 7 {PuA)f + r]Puid)Huii) + 
iGl>„ V T6'D 


AT.i 

2/0 


- (4ci ((-75^ + A - a^)H^{i) - ^ (ff„^(*))' - 5P^(i)Hui}) + 4) 

, Af(i) oAf , 3 1 

+ OCl (HNU))‘iPH + 2S (H^aW^Pn au 


= E 


n ( N 1 7- ■\-nN/-\ P,Ai) iP^ii)T , 

^ a, / 2ci Up(^^^m(7,j)P, (j) - ^- 7 

v-n «/0 \ xr-'Tt 


H” t 


iGP^ \ iGl> 

N 1 o 5 ...Af 


pwnw 


- 2 (-Kp + A - a^) 


A^^ Afb) , .A _ o.iv Afb) 

K HS'ii) iH(f{i))'^ PVWiW 


,q_SfW «JV , 7l^A+5L 1 

“r ^TzTnTp^PH I ' 




Af (d 




3/3^ 


5' (//«)^ A’5 (H^Y "5 (H^Y 25 (H^ {i)Y 


du 


(46) 


(47) 
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Using Young’s inequality as well as Lemma [2^ we get for all t £ [0, oo) and all TV, n, I G N that 


E 


P^^^N,n W 


.iGT>r. 

< E 


N,n 

...Ti 

rtArf^ 


N.n 

Vo 


2ci lAtf 1 


/o 


3'^P 


i-gKpC ^ThJIW 


iePn 

1 A „ I ,Af 1 _ or-K-JV 4_ \ _ -.Af'i -P.f(d , lifoA p.f(d 

2 '2r)P (H^{i)Y ■'■ 2 A ''-P {H^ {i))'-‘ P'H + ^ « 1 {H^{i))'^ 2 4 ^ K (H^(i))'^ 


{P^(.^y n.N P,fW , o UfW , >c^-A+a '’' i 




CwJT 


I 1. if A 1 _i_ i A ^ _i_ (d _ in. 1 I -^Ph 1 J,, 

"'■ 2 2 ifiS (H^Y K K5 P~ (H^Y ^ {H^Y 25 {{H^ {i)Y 


= E 


’ N 1 r / 

E “ i'-P + (ff/(i))^ + 2 £i^p£ p Cl - 2 j^ + 


zGX) 

,iv 


+ 4« - A + + l) 

2ci5^ " ' 


+ 1 


”*" ~*" \h^\yY + 2ci X + ^ (*) 




N I A+a^ I ^ 

5 '^46 


hlW + [-^‘'H + 3^p] (H^ul‘i 






(48) 


Recall Kp = supivgi^ k^, and that for all G N we have < f, tp < and 

Furthermore, note that -j < Together with the assumption that 7 > 25 we see for all t G [0,oo) and all 

N,n,l €N that 


E 


/ P'^ iv„(d 

^uj 2 c-^' ■ 1 


.i€T>r 

< E 


N,r. 

-Vo 


E 

-ieVn 


AfnW)" + 25(ff« ^„W) = 

■Axj tAXj 

At"'" 

^«pc (P„^(z))^ - 7^^ + 2ci 


221 I 4A 
X 


pJ^(i) _ A _ 1 _, + > 

V‘2 45 {H^(i)Y ^ 


du 


pt _ ' / N ■ \ 

< c^du-E '^CTi I (2ci ^ (i//(O)0 

LiGPn 


dit 


(49) 


Using Tonelli’s theorem, Fatou’s lemma, and m this implies for alH G [0, 00 ) and all N,n £ N that 


N,n 

Vt 


A A' 
^0 


du = yf^’" + E 


rr f ^ /^7- U)^(d I 1 1 A 

2_^ di j 2 (H^ii))'-‘ 25 {H^{i)Y J 

. 2 GP„ 


du 


< liminf E 

I —^00 \ 


E Ew)" ^w^itjay 


.i^T>n 

+E 


N,i 


ptAr^'^ 

E - J i 2c: 

4GP„ •’'0 


PfW 


1 (H^{i)Y 25 (ffW( 


w) 


du 




(50) 


For every A^, n G N let z^’”: [0,oo) —>■ R be a process that for all t £ [0,oo) satisfies zf^’" = Zq’^ + f* (cg — 
■jz^’") ds with Z(^’" = Uq’^, where uniqueness follows from local Lipschitz continuity. Due to classical com¬ 
parison results of the theory of ODEs, the above computation yields for all t £ [0,oo) and all A^, n G N that 
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and for all N,n £N that suptg[o,oo) ^}- We obtain for all n € N that 


N,n ^ N.n 

sup sup < sup sup = max 

N^Nt^[0,oo) N^Nt^[0,oo) 


j N,n 

< sup Zq 

Ingn 



< sup E 

NGN 


cTi 1 2 ci 




+ 


2c" 


Using monotone convergence we thereby conclude 


(51) 


sup sup E 

NeN tG[0.oo) 



2(5 




/ 1 - -'V,! 

< lim sup sup j/j 

ra-!-oo ArGNie[0,oo) 


< lim 

n—>-oo 


sup E 
atgn 


’y] <Ji f 2ci 
.jgx>„ ^ 




+ 


^^0 

A 


< sup E 

NGN 



4:KpC 

3A(A-|-i'') 


sup sup E 

NgN tG[0,oo) 




(52) 


4 

A( A+2/) 




sup sup E 

A^GN tG[0,oo) 


i^T) 



finishing the proof. □ 

Lemma 2.7. Assume the setting of Section \2. 1\ and assume \ > v and rj — p > Furthermore, assume that 
for all N G N we have > ^/3^, Kp + Kp + '-p ^ Ppi o,nd tp > /3p. Let f> C V be a set. Then 

we have 


sup sup E 

AfGNtG[0,oo) 


1 _I 1 ^ 

2{iip+u) Pfnj) Pjf ii)H^ (*) J 


iGP 


< sup E 
NeN 


E-( 


{v-p)--k 1 


2(Rp+<i) FfU) + TfWT^ 


iGV 


H- 

min-< 


Jbp+.A^I I + (7 + ^) sup sup E 

|KP+p. 2 1 \ y 1 NeNtGlo.oo) 


NgN tG [OjOo) 




iGV 


(53) 


Proof. If the right-hand side of (1531) is inhnite, then the claim trivially holds. For the remainder of the proof 
assume the right-hand side of (15^ to be hnite. Define Vq := 0 and for every n G N let Vn C 27 be a set with 

|27„| = min |n, |27|| and 27„ D Vn-i- Define cq := 2 (r.p+v) [(^ ~ P) ~ every n G N let 


C" := 7C0 + 

p + 5 

sup sup E 

7 . HP (P 



JVeN tG[0,oo) 

-i&Vn 


(54) 


Note that due to the assumption p — p > we have cq G (0,oo). For all N,n,l G N define [0, oo]-valued 
stopping times 

E" := inf e [0,oo) : E ^ ^) > Uoo^ . (55) 

We infer from Lemmas [2.2l and [^l?l that for all n G N the map [0, oo) 9 t >->■ X)iGX>„ ^ ^ 

R is P-a.s. continuous which implies that we have for all t G [0, oo) and all n G N that 


lim T, 
I—¥00 


Na 


< t 


= 0 . 


(56) 
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For all t € [0,oo), N,n,l gN applying Young’s inequality we see that 


E 


E 


N,n 


Ugx>„ 

< 


{ yMWW) I 1 

\TpF(w V ° )) 


du 


t sup ^ 


P 


N 




{<} \ 5 V “Ar, 


‘(*)) + I ('=0 + 


- 1 ^ 


< 


0P 


H} 


E 


t sup E 

1*6 [0,t] \i^x>„ 


( 




JV.nU 


+ Co 


du 


ppt{l+ca\\l\Uf 

k(=T)^ ^ J 


(57) 


and 


E 


N,‘n 


E 




du 



(•))■'+ i(r.Y»..(.))") 


Y ''• ((^7ax”'-(')) + (r,”x,"-(0) 


du 


(58) 


< 




H} 


< oo. 


Hence, we obtain for all t G [0,oo) and all N,n,l G N that 


E 


E 


ntAr, 


g (»» + B^) 


= 0 , 


i^T>, 


(*) (d\ 


(59) 


= 0 . 


Define the function y: N x N x [0,oo) —>■ [0,oo] by 


N X N X [0, oo) 9 (iV, n, t) := E 


E (*^0/^ + P«(i)W(i) 




(60) 


Recall from the beginning of the proof that we assume for all N,n gN that < oo. Applying Ito’s lemma 
and using (l5iB . we get for all t G [0,oo) and all N,n,l gN that 


E 


E 


I Cq pw 


-iGP, 

= E 




+ 


tAx, ’ tAxf 


. 0 ) 


N,r 

-Vo 


E 

.i£T>n 


ptAr, 


(P«(i))’’ JpF(A 7~H^ {i), 






- {k^ + v)Pu{i) - 1 {Pu{i)f + (d - pFuii)) Pu{i)Hu{i) + '-p^ + h<^o-fpW(-^Pp Pu (i) 

+ - pN(i)(\iS(G)Y ( E O') + (-«p + A - a^F^{i))H^{i) 


(61) 


- ^ (^.^(*))' - dP0'(*)i7„^(*) + 4 + du 
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Dropping some negative terms, we now get for alH e [0, oo) and all N,n,l G N that 


E 


.ieT) 

< E 






.W 


N,n 

Vo 


N,n 


cpFwF 


- (k^ + iy)P^{i) - 7 {Pu{i)y 


= E 


+ (7 — p) P^{i)Hy (*) + + coPp ^P (pN(i)f pN(j) + Ph p«(z)(ff«(i))^ 

■ + ^ - ^ - sp^m^ii) + 4) 

ptAr^’^ ^ 

CTi / (pp + v) Co pN(i) + 7 C 0 — iv — P)co pW(i) ~ '-pCO (pJV^(i))ii + (^P + pN(j)pN(j) (62) 

iGP„ •^0 


drt 


JpFiWWiii cpFwF JpFiWWii) ”*" 'pFWh¥p)7 

— (— Kp + A — q; ) p«(i)pN(i) + 7g P«(i) + pN(i) ~ '•P {i){H^(i))'^ 


= E 


_^ ptAT^ ’ ^ 

CTi / [(k^ + p) Co - (7 - p) + ;^] + 7Co “ “ p)co^^ 

iGP„ 


+ [—'-pCo + co/?^] (pw^(i))^ + [(^p + — (—+ A — a^)] + [7 + <^] pw(i) 


+ [-'-p + /3p] ipNpiVWP) ~ 


P^ (i)(H^ (i))' 


■ du 


Recall from Section |2. II that Kp = suppgf^Kp, and from Assumption II .ll that A>p, p — p> and that for 
all A^ G N we have Kp + Kp + a'^ < tp > /3p, and ip > /?p. Hence, we get for all t G [0,oo) and all 
N,n,l gN that 


E 


('^Op" ^,„W + P, 


.i^T>n 


< E 


E 


ptAr, 


577- 

t At, 


K,nWP~ ^,,„W 


N,n 

Vo 


- {up + p) Co pN(j) + 7C0 - pW(j)pW(i) + [7 + ^] pN(j) 


(63) 


< / ^"dM-E 


/ X 

/ mm {kp + P, cr^ ( ^°piu) + pP(i)pP(d) 

ieP„ 


du 


Applying Tonelli’s theorem, Fatou’s lemma, and (l56ll we obtain for all t G [0,oo) and all N,n gN that 


yf+ [ min { Kp + p, ^ } y^’"- du 
Jo 


N ,71 I -fT^ 

= yt + E 


< liminf E 

I —^00 \ 


[ min { Kp + p, V } E (^0 phi + P^ (bE (d ) 

iGP„ 


du 


E ^Op" lAi 




(64) 


+ E 


^■,71 


.. Jb P" «„(d 

tAT^ ’ tAT^ ’ tAT^ ’ 


{kp + A E P~ (i)W (d ) 


du 


i£T>n 


<2/E+ / 

Jo 
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For every n € N, let [0,oo) —>■ K be a process that for all t G [0,oo) satisfies = Zq’"^ + (C” — 

min {kp + ly, ds, with Zq’'^ = Uq'^, where uniqueness follows from local Lipschitz continuity. Using 

classical comparison results from the theory of ODEs, the above computation yields for all t G [0,cxd) and all 
N,n gN that < z^’" and for all N,n gN that supjgjQ^^^ zf^’" = max Hence, we 

obtain for every n G N that 


sup sup E 

Nen tG[0,oo) 


E 

.i£T>n 


(coj^ + p«(i)’p«(,)) 

C' 


N,n 


N,n ^ N,n 

= sup sup < sup sup Z( 


NGN iG[0,oo) 


NeN tG[0,oo) 


= max < sup Zn , . r - x—rr 

IatgN ° mm{Kp+i., —} 

I) ^ p^'' (i)W (b 
Using monotone convergence, we thereby conclude that 


(65) 


< sup E 

ATGN 


i6l>„ 


min|^tp+i/, j. 


sup sup E 

iVGN tG[0.oo) 




iGTi 


< lim sup E 

n-)-oo \ tvgN 




= lim sup sup E 

"•-*-°°ArGNtG[0,oo) 


E ('^ 05 ^ + P«(z)W(i)) 










= sup E 

iVGN 




(i) ' PS‘{i)H^{i) 


_i£D 

finishing the proof. 




iveNte[o,oo) 


( 66 ) 




min|^tp+iv, 


□ 


Theorem 2.8. Assume the setting of Section \2.1\ and let Assumption[TA\ hold. Then for all (x, y, z) G (0, oo)^ x 
[ 0 , 1 ] it holds that 

u{x,y,z) := (77 - pz) (^x - h^{z) - h^{z)\a. ( 77 ;^)) +S (y - Poo{z) - Pooiz)\n (^;^)) > 0- (67) 

Furthermore, there exists a eonstant cg G (0,oo) such that for every set T) FT), for every iV G N, and every 
t G [0,oo) it holds that 


E 


^a.w«(*),Pf(*),Ff(*)) 


LzGI> 


+ 


/ iv-p) 


+ dyE 

E {Pu if) - Poo {F^{i))f 




i^f> 


du 


( 68 ) 


< E 




iGV 


+ tco max {k^, Kp, a^, t^, 6 p,/3^,/3p } . 


Proof. For the remainder of the proof fix a set V F V. Define Vg := 0 and for every n G N let C V 
be a set with |P„| = min|n,|P|| and F P„_i. We will first show that for all {x,y,z) G (0,oo)^ x [0,1] 
it holds that u{x,y,z) > 0. Define for all x G (0,oo) the real-valued function (0,oo) 9 y !->■ fx{y) '■= x — 
y — yln^^y For all x G (0,oo) the function fx has for all y G (0, 00 ) first and second order derivatives 


QTirl ^ F {fii^ — d ^_ ^ i.±Lio l\jl cjh 

X with fx{x) = 0. Consequently, for any {x,y) G (0, 00 )^ we have fx{y) > fx{x) = 0. This shows that for all 


dy'iy) ~ l'^(2/) ~ ln(x) and = y ^ 6 . Thus, for all x G (0,oo) the function fx has its global minimum at 
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{x, y, z) € (0, oo)^ X [0,1] we have that u{x, y, z) > 0. In order to prove the second part of the claim, we will 
make use of a Lyapunov function that is defined here analogously to the well-known Lyapunov function in the 

deterministic setting. Define Dy '■= H (0, oo)^^ x fl (0, oo)^^ x Ei. For any subset f>' <ZT> define the 
function Vf,,: Dy [0, oo] for any {h,p, f) S Dy by 




i£T)' 


(69) 


Due to the non-negativity of the mapping u, we obtain for any I)' CV and any z € Dy that Vfi,(z) € [0,oo] is 
well-defined. From the fact that for all x € (0, oo) we have — ln(x) < Dy < ^ (y -I- l) as well as the assumption 


SUPATgN 


E 


(H^ + + (^rj2 + 7^ + 


< oo we obtain 


(tJ 

snpE[Vn{H^,Po^,Fo^)] < oo. 


N£N 


(70) 


We now calculate the first and second order partial derivatives that we will need in the application of Ito’s 
lemma below. For all n € N, ^ = {h,p,f) € Dy, and i £ we get (z) = cFi{r] — pfi)[\ — 

and as well as 


hi 1 ’ 


dV-Dr 

~ 


iz) = 


- p{hi- hi^ifi) - hiyoUi) In (7^^)) + (^ - Pfi) f - h'^Ui) “ In 


(/»oo(/d)" -h, 

hi {h^Ui)) 


r^'oo(/^) j + 6 (-p'oo(/i) - P'oo(/*) In {jffj:)) 


(Poo(/i))^ -Pi .X 


Pi {Poc{fi)V 


■p'ooiL 


(71) 


p(hi- In ( 71 ;^^)) -iv- Pfi)h'iyo{fi) In ~ In 


and 


p(/i'oo(/0 + /i'oo(/.)ln(7r;ife) +^^'oo(/Oln(7rir77)) 


{n - pfi) (^'c^(/i)in (h^^ikyd 'oaih)) 

s (p'Lih) In + p’oo (/») ipd(7i)y^ P'oo (/o) ( 72 ) 

2p^'oo(/0 In - (r; - p/0 (/^'^(/O In 

- ^ {p'Lif ^)In [jzth)) ~ (7^'oo(/0)^ 

Recall that we have for all x £ [0,1] that hao{x) = and Poo{x) = y ^1 — 777 ^^ 377 ^ and note that the 

assumption that p — p > -^ implies for all a: £ [0,1] that Poo{x) > 0. Therefore, we get for all a; £ [0,1], 


^^ 00 ( 2 ;) — b{a-xy > h'f^ix) — b(a-x)^ > 

Pooix) = — SKb(a-xy^ ^ Pooix) = ~ SKb(a-x)^ ^ 


(73) 


So hoo, h'^, and are strictly monotonically increasing on [0,1] while Poo, p'oo^ and p'f^ are strictly mono- 

tonically decreasing on [0,1]. Also we have that max Spooix) < A. Observe that for all x £ (0, 00 ) we have 

xe[o.i] 


19 
























































|ln(a;)| < Together with Young’s inequality as well as Lenimas l2. 5112.61 and l2.71 we get for all t G [0, oo) 

and all N,n € N that 


E 


E 


and 


and 


.ieVn 
< sup E 

[0,i] 






p^(i) 


du 


< IdpS^E 


E 1 du 


.ieVn 




.i&T'n 


< oo 


E 


.iGVri 


E - pF!^{i)) (l - 


/«oo(F"(i)) 

hTU) 


du 


< PeP sup E 
lie [o,i] 




.iGX>„ 


< OO 


E 



ijl - pFu ii))h'^{.F^ii)) In (jdbM^) ~ (*)) In ( pj(>]^(i)) ) ) ) du 


< /3ffE 


E 

i^T>rt 




pH^ {%)+ph^{i)+ph^{i) 


du 


I I V^A I (1)1 ( I 

^ cri2^ (*) + (doo(l))^ (iT^ + hZW) + (ffF(i)f) 

iev„ \ 

+ {d'ooi^)f [hAm + (ffFw)O (^’'oo(l))^ 


< Ph sup E 

[0,t] 


< CX). 


(74) 


(75) 


(76) 


Hence, we obtain for alH G [0, oo) and all iV, n G N that 

rt 


E 


E 


E 


1615 


= 0 , 


E (l - dWF^{^ 

i^'D-n. 

^ - pF^{{)) (l - Mmp) dWP^{{) 

p (h^{i) - h^F^^ii)) - doo(F,^(*))ln [ uS%)) )) 


= 0 , 


E 

iex>„ 


_ ,, PK^’"w(i--F"b)) 

CT,;\/ H^{i) 


(77) 


-(P - pFA(.^))d'aoiFAii)) In (/db^ij)) ~ ^P'oo{FA{i)) In ( pJ^>W(q) 


dWF^it) 


= 0 . 
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For all t € [0, oo), all N G N, and all i G 2? define 
R^{i) := max 


I max|77c,pc,p,c7?^f^,?7jf^|i2f (I),??, 

max|ip2 (i))2^ 3^1 (1))^| (77/1'^ (1) \//ioo (1)) " (l)/ioo (1) 

1 (d 1^2 1^7 /I m2 Poo(O) 

2^\Rt 1 A^\^t (,*Jj ’ 2 ^ ^p^(l) y IPoolljl P«{i)H^{i) ’ 


(78) 


<5b'oc 


Poo(o) ^ |p^(i)| pf w I 

P"(z) ’ ^?loo(0) ’ 2 Poo(l) P"(z) ’ (’ 


:= max{K^,K^,a^,t^,i^,/3^,/3^} . 

Note that lim 6-^ = 0. Define cq := 32 sup sup E r||i?0^|| 1. Observe that due to Lemmas 12.5112.61 and 12.71 
N^oo MeNuG[0,oo) 

we have cq G (0, 00 ). For all t G [0, 00 ), all iV G N, and all a G |? 7 , p, have that 


a^a Y miiJ)H^ij) < Y <^rCaH^{i) < Y (*)■ 

i^T> j^T> i^T> i^T> 

Furthermore, we have for alH G [0, oo) and all € N that 

Y Y < Y < Y (*)■ 

i^T> j^T> i^T> i^T> 

Using Young’s inequality and Lemmawe get for all t € [0, oo) and all Y G N that 


Vrr 

H^{i) 


i£T> 


iGP ieP V ‘ JGP / 

< ^ (*) + ic {H^{^))A < Y 

iGP \ / iGP 


and 


T. -(Mipro) < E -.11 (^^)‘+(E 

igi) igx> \ jeP 

< ^ uAf (*) + ic (i7f (f))' ) < ^ a.2i?f (*), 
ieP \ / iGP 


and 


^u,(-l)Voo {Ft^ii)) Y 


Pf (i) 


< Y^J ^r(*)+3( Y 

iGP V 

< y]a,3i?f(i). 


JGP 




(79) 


(80) 


(81) 


(82) 


(83) 


i^V 
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Again using Young’s inequality and Lemma [2^ we get for all a G |/o(/ioo (1)) ^ all t G [0, oo), 

and all Af G N that 


zei> 


j£Ti 



iGX> \ iei> 

< ^ a/Rf (*) + ic (fff (*))' ) < ^ a.2i?f (i). 


(84) 


iGl> 


iev 


Due to Lemmawe have that W^’^{i), N G N, i G V, are independent Brownian motions and due 

to Lemmas 12.5112.61 and 12.71 we have for all t G [0,oo) and all A^ G N that P-a.s. G Dy- Thus, 

applying Ito’s lemma and using (1771) we obtain for all t G [0, oo) and all TV, n G N that 

E («, P,^, Pf))] - E [Yi,„ {{H^, Po^, Po^))] 


= E 


/ XI f (^ “ (*)) X j) {HuU) - Huii)) 

ieT>rt \ \ 

tN 




(85) 


+ ff:(*) [a (l - ^) - + 4 } + 

+ (5 A - ) {«:p X - ^^(*)) 

+[-^ - 7^^„^(*)+(7 - p^’„^(*)) i?„^(*)]+ + 

- (Fuii)) - (Fuii)) In { hlS^%)) ) ) “ (^ " pFu i^)) h'^ (^«^(*)) In ( hfSj%) ) 

- Sp'oo {Fu{i)) In ( pj(>jv(,)) ) {kp m{ij) {F^{j) - {{)) ii) (l - F^{i)) | 

J jdV 

+ \^PPao \^u (*)j in yh^{F^{i)) ) 2 \Poo u (*)j in yh^{F^{i)) ) h^{F^ (i)) 

- (F^(P) In V, . 

2 [Poo[P^u (*)) in \p^{F^{i))) Poo(J’"(d) ) J PJTd ) 

Note that for all x G [0,1] it holds that 0 < r] — px < r]. Together with the fact that for all x G (0, oo) we have 
ln(x) < ^/x, ln(x) < X, ln(x) < ^/x + y^, and ln(x) < x + and dropping negative terms, this implies 
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for all t G [0,oo) and all N,n gN that 

E («,Pf ,F,^))] -E [yi,„ («,Po^,Fo^))] 

< E f ^ cr* m{i,j)H^ (j) + T]h^ {F^{i)) k 

° ^eVr^ \ jev 


+ iv - pFu {^) [Hu - hoc {F^ {i))) A (l - - (5Pj^(z) + 'qh^ {F^ {i)) + rjL^ 

+ %hao {F^ (i)) PhTJ^JT) + (•?) + i^u (0) 

jGP 

+ S {P^{^) - Poo {F^m [- 1 ^ - + {v- pF:^{{)) H^{{)] + 5i^p + 


+ X! (•?') + pHuiih^ + P nfii)^ 1 + /»J(pj'W) 

JGP - y « 


+ X! + P^OO + p/j'oo (^^(*)) (^]J 


jGP 
J ( l?N / 


(f"(d) 


+ ?^=o(PPW) ) " 1 V Poe(P„^W) + V “TO 

+ U'oo 7r;;f^ - Voo {F::^{^)) 


jeP 


, w 


+ nh' ((i)) (P) Ph -u ll(h" (F^(iS\ _(_ (^oo(P“ l®l)) 'l Ph 

+ P'100 fPii 1*1 j /ioo(P"(i)) «"(*) 2 l^Poo iPtt l*lj P« (i) I '‘oo(P"(d) / -f*" (j) 


+ i/_„" , (pk(£^WA PS 

+ 2 I PooK^u 1*11 Poo (P«(i)) pZiFWWr J TWF) j 

Using (17^ . (l80l) . (1^ . (l82]l . (IMll . and (|Mll we get for all t G [0, oo) and all N,n G N that 
E [Ui,„ ((Pf ,Pf ,Ff))] -E [U^,„ ((Po^,Po^,Fo^))] 


< E 


r^'T,U^32P))^(*) + (v-pF^(t)) {Hi;^(i) - h^ {F^ii))) \\ (l - - 5P^{i) 

•*0 iei, V L V / 


+ 5 {P^{i) - Poo {F^m -y- iP^ii) + (p - pF^{^)) H^{i) 


du 


Note that for all x G [0,1] we have 

At, -L a f, _ \ — <^Ai<'(7)-pa;)-aAi/+AAi^+A^7 _ , _ SK(7j-px)+Aj \ _ \ _ n 

OPooiX) + j^PoolX) A— Aj+SK(7j-px) ~ ^J+SK(p-px)A — U, 

. - (, - + -ip^i.) = . - ^ = 0 . 

From ((Ml) we see that for alH £ [0,oo) and all N,n gN it holds that 
E [U^,„ ((Pf, Pf, P,^))] - E [Ui,„ {{H^, Po^, Pj^))] 


< E 


^ aJb^32R^ (1) + (p - pP„^(*)) (P„^(*) - /ioo (*))) [a - i(p„^(i) - /loo (P„^(*)) ) 


i£T> 


s[Pui'i-)-Poo{F^ii)))-X +(5(Pj^(i)-Poo (Pj^(i))) - p-7(-Pf (*)-Poo (Pj^(*))) 


+ (p - pPj^(*)) P„^(*) - /Too (P„^(*)) + 


du 


( 86 ) 


(87) 


( 88 ) 


(89) 
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Hence, we obtain for every N,n gN and every t G [0,oo) that 



(90) 



Applying monotone convergence we now see that for every N £ N and every t £ [0, oo) we have 



+ <^7® - Poo {F^{i)))^ du 


i£T) 


(91) 



+ < 57 ® ^ < 7 . {P^{i)-Poo {F^{i))Y < ® ] + tb^co. 


-ieVn 


The set P CD was arbitrarily chosen and thus, this finishes the proof of Theorem 12.81 


□ 


2.4 Convergence of relative frequency of altruists 

2.4.1 A relative compactness condition 

For convenience of the reader, we restate Lemma 3.3 of Klenke and Mytnik |20) . 

Lemma 2.9. Let V he a countable set, let a £ (0, oo)^ such that ^ ■“ ^ ■ ll'^IU ■= 

X)iex> < oo}- 4 subset K C l^. is relatively compact if and only if 

(i) sup,,g;f ||x||<, < oo 

(ii) for every e £ (0,oo) there exists a finite subset SCI) such that sup^.^^ I|2;lx>\f: lU < £• 

Lemma 2.10. Let (12, P, P) be a probability space, let P be a countable set, let a £ (0, oo)^ such that < 

oo, let l]j := {z £ : \\z\\a := ^ °®}’ -®2 := oo)^, let L be a set, and let Z®: 12 —?► E 2 , i £ I, 

be a family of random variables. Assume that s\xp^^j¥\\\Z''\\c] < 00 and inf 5 cx),| 5 |<oo supjgj crfeE[Z^] = 

0. Then the family {2’® : i £ L} is relatively compact in E 2 . 

Proof. Fix e £ (0, 00 ). For each to G N by assumption there exists a set Sm,e ^ P such that 


sup 

iei 




(92) 


keV\Sm,e 


Define the set Kg C E 2 by 


Ae a; G £'2 : ||a:||cr < 



(93) 
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Due to the Heine-Borel theorem we can apply Lemma 12.91 to obtain relative compactness of Kg,. By Markov’s 
inequality we get 


supP ^ < supP Z* i 

L J jg/ L 


< supl 
i€l 


< 


lz^L> 


2supjg fE[||Zq 


sup^p[ ^ <^kZl>^ 


iGl 


m=l kGV\Sm,e 


(94) 


— 2sup-gj E[||ZJ|| 


■ supE 
iei 


msup cTfeE zi < § + y]] w 


m=l kev\s. 


2m^(m+l) 




m—1 


Since e was arbitrarily chosen it follows that {Z® : z G /} is tight in £’ 2 . Due to Prohorov’s theorem (e.g., 
Theorem 3.2.2 in Ethier and Kurtz [7]) the claim follows. □ 


2.4.2 Proof of Theorem 11.31 

Lemma 2 . 11 . Assume the setting of Seetion \2.1\ and assume that for all N G N we have ^ 

00 . For all n G N denote by m" the n-fold matrix product of m. Then we get for all t G [0,oo), all i GT), and 
all N gN that 


E [ijy(z)] < E 


EE< 

j^T> n=0 






(l + Vl + ^)- 


(95) 


Proof. We have for every n G N and every i,j G V that mA(i^j) G [0,1]. Hence, we get for all T G [0, 00 ) and 
all z,j G H that 

00 

E < oo- (96) 

„=o‘6[OT] 

Thereby, for all t G [0, 00 ) and all i,jG'D we can define 

00 

e-%m^{i,j). (97) 

n—0 

By (1^ and using dominated convergence, we can compute for all t G [0,oo) and all z,j GV that 


Tt^t 


{i,j) = -mt{i,j) + E ® = -mtiij) + E® 


— t t n+1 


ihj) 


n—1 


n—0 


= -mt{i,j) + E ® *!rr E = Y mt{i,k){m{k, j) - lj=k)- 


(98) 


n =0 


kGV 


k£V 


Furthermore, note that for all t G [0, 00 ) and all i G 21 we have 

00 00 

Ewt(z,j) = E = E®”‘^ = 

jel) n=0 n=0 

For all t G [0, 00 ), s G [0, t], z G 21, iV G N define 

■■= Y (100) 

je-D 

Observe that since for all i,j GT) it holds that ~ li=j we have for all t G [0,oo), all i G V, and all 

iV G N that 

y,^y*) = i 2 f (z). ( 101 ) 
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Furthermore, using jS]) we have for all t G [0,oo) and all G N that 



n^’‘(i) 

= y^ffzE 


iGT> 


i^T> 

jeT> 


E E E j)E [<(j)] 

i€T> j£T> n=0 


= EE^ 

j^T) n=0 


-tK^ (tK^y 


■IE [HqU)] < EE® 

i£T> j£T) n=0 


E [<(j)] cV, 


( 102 ) 


= E [<(■?■)] [WKU ■ 

j£T> n=0 


For all t G [0, oo), s G [0, t], i,jGV,NGNwe see from ([M|) that we have 

fs^(t-s)K’^{h 3 ) = -Kh E ^{t-s)n^(.hk){m{kj) - lj=k)- 


ke-D 


For t G [0, oo), / G N, * G 2? define 

:= inf ({m G [0,t] : Y^’*{i) > /} U oo) . 


(103) 


(104) 


Using the fact that for all t G [0,oo), all u G [0,t], all A^ G N, and all i,j gV we have G [0,1] we 

get for all t G [0, oo), all s G [0, t], all A^, / G N, and alH G 2? that 


. N,t / ■\ 

f^sAr^ [i) 


jev ^ /Jo jgj, 


jev 

. N,t / ■\ 

f'SATi (z) 




(105) 


For all t G [0, oo), s G [0, t], * G 2?, A^ G N using Ito’s lemma with (IMll and (110311 we get P-a.s. 

- Yj^’*(i) = / E E + (A - {j) 

"'0 jev \ kev 

- ^ {HuU)Y - {j)Pu{j) + iff ) - E E k){m{kj) - lj=/c)i2^(j) du 

/ jeT) fceff 

jeT>do 

= / E ™(t-«)«g(Ai) (A - a^Ff'(j)) H^{j) - ^ {H^ (j))^ - SH^{j)P^ij) \ + du 
do jg-p V / 

+e| 

jev^o 


(106) 


< 


U) - ^ +L^du 

v"r 


jeT> do 


+ E/ ^{t-u)^^i.h3)\J ldHHu{3)dW^' (j). 
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Thus, using (11051) and (110611 we get for all t £ [0, oo), all s G [0, t], all i GV, and all N,l gN that 


E 






psArAHi) 

1 sATj^ ’ (t)^ 

-E 


< E 






do jev 


< E 


= / AE 


/ + ‘-H du 

0 A ^'r\ 

+ i^du < tb^ + ^ [ IE 


jev 


( 107 ) 


uAt^ ’ (i) ^ \ 


uAr^ ’ ( 2 ) ^ \ 


du. 


Now, using Gronwall’s lemma (e.g., Klenke [H]), we get for all t G [0, 00 ), all s G [0, t], all i G V, and all N,l G N 
that 


E 


< (e +K) < (e [yo^’*(z)] +t4) 


.Xt 


(108) 


For all t G [ 0 , 00), € N, i G P the P-a.s. continuous paths of tj imply E sup^gjQ j] Af’‘(*) < 

= 1 . Hence, we get for all t G [ 0 ,00), all G N, and all i G 2 ? that 


lim r,^’*(i) = 00 


= 1 . 


(109) 


Using the assumption that for all A^ G N we have ^0 (*) < 00 together with (IIOII) . (I102|) . (I108D . 

and (11091) with Fatou’s lemma we obtain for all t G [0, 00) and all A^ G N that 


^ u,E [i2f (*)] = ^ a.E \Y,^’\b)] = ^ u,E 


i£T> 


i^T> 


i^V 


lim (i) 

;_>oo ’ (O' 


< Gi lim inf E 


i^T> 




l^oa I ’ (0 


< ^ (Ti lim inf ^E Y^’*{i) + tb^ e^* = ^ Ui ^E ® 

iei> iev 

< ('e‘''-(^-i)E[|K||J < 00. 

V IGX) / 


( 110 ) 


Using the fact that for all t G [0,oo), all u G [0,t], all A^ G N, and all i,j G V we have j) G [0,1] 

this implies for all t G [0, 00 ), all s G [0, t], all A^ G N, and all i G V, that 


E 


(b j)\jUij ^ / ® 


je-D 

<P\ 


E 

jev 






du 


H I E 
0 


jeT> 


du = 13 ^ f E [Uj^’‘(i)] du < 00. 
Jo 


( 111 ) 


Thus, taking expectations in (11061) gives for all t G [0,oo), all s G [0,t], all i gV, and all Ai G N using Jensen’s 
inequality 



< r [AE[y/-‘(*)] - Ae 



^0 \ 

je-D 


+ b^ du 


< AE y*)] - Ae (Uj^y*))' 


~t“ bf^ du 


( 112 ) 


< / AE [yj^y*)] - A (E [y„".*(*)]) + Iff du. 
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For t G [0, oo), i € V, N € N let z^'*{i): [0, oo) —?► R be a process that for all s G [0, oo) satisfies 

’‘(0 = Zo’\i) + ^ {zu'\i)f + Ih) du (113) 

with z^’*'{i) = E where uniqueness follows from local Lipschitz continuity. Define ci + 

\J^ G (0,oo). Using classical comparison results from the theory of ODEs, the above computation 

shows that for all G N, all i G P, and all t G [0, oo) we have 

E[F1 /^(i)]=E Y^’*'{i) < < max|E Y^’*{i) , limsup 2 ^’*(i)l = max |e Yf^’*{i) ,ci| 

L J L J s^oo J -I ^ 


< E 




■ Cl = E 


jeT> 


■ Cl 


This finishes the proof of Lemma 12.111 


(114) 


□ 


Proof of Theorem \l.,‘A We will use stochastic averaging (see Theorem 2.1 in Kurtz ED) to prove the result. 
So we first check that all conditions of the aforementioned theorem are fulfilled. Note that Ei = [0,1]^ and 
E 2 = ll n [0, 00 )^ are complete separable metric spaces. Tychonoff’s theorem implies that Ei is compact. 
Since for all G N and all t G [0, 00 ) the random variable takes values in the compact space Ei, the 
compact containment condition holds for { {FtN)t^iooo) ■ S N}. We will now use Lemma [2.101 to show for 
each T G [0, 00 ) that the family {H^ : t G [0, T], A^ G N} is relatively compact in U 2 . From Lemma [2.51 and 


the assumption sup^gj^E 


4i 


< OO we see that 


sup sup E [||iL/)(f|| 1 < 00. 

WGNtG[0,oo) 


(115) 


Define Vq := 0 and for all n G N let C 2 ? be a set with |T>„| = min{n, |T>|} and D Pn-i- Define 


Cl := -y ^1 + Y^l + . From Lemma [2.Ill with the assumption that s^PAreN 

for all T G [0, 00 ) that 


CTiE 




< 00 we get 


^CTjSup sup E [iJ 4 ^(i)] < sup sup m"(i,j)E [g^(j)] +ci 


■ JVGNte[0,T] 


ieT) ^ 6 NtG[ 0 ,T] \j^xin =0 


< ^ ^ ^ sup sup e *f^E [i2(f (j)] + ci ^ cr, 

j^T>n=0 Kiev / te[0,TNK.^] jg 25 


(116) 


< ^ ^ c”crj- sup e [H^{j)] + Cillill^ < e (Jj sup E [i2,f (j)] + ci||l||^ < 00 . 


iVGN 


NeN 


je'Dn=0 jeT> 

Now we can use the dominated convergence theorem to obtain for all T G [0,oo) that 


lim sup sup 7 (TfeE Hj^{k) < lim sup sup dfeE Hj^{k) 

I keD\D^ 




= 0 . 


(117) 


Hence, for all T G [0,oo) we can apply Lemma [2.101 to the family {H^ : t G [0,T], A^ G N} and conclude that 
it is relatively compact in U 2 . Denote by Cb(Ui,R) the set of bounded, continuous real-valued functions on 
El and by {Ei , R) the set of all real-valued functions on Ei that are twice continuously differentiable and 
bounded, with bounded first and second order partial derivatives. For / G ( 7 ^( 251 ,®) let c/ G (0, 00 ) be such 


that for all x G Ei and alH G 2? we have 


JL 

dxi 


{x) 




dx. 


■{x) 


< Cf. Define 


Dom(7l) := {/ G C'^{Ei,M.) : f depends only on finitely many coordinates} 


(118) 
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and for any / G Dom(yl) denote hj Vf the finite set of coordinates that / depends on. Due to the Stone- 
Weierstrass theorem (e.g., Theorem 15.2 in Klenke [TH]) we see that Dom(^) is dense in Cb(£’i,R) in the 
topology of uniform convergence. Denote by C{Ei x i? 2 ,R) the set of real-valued continuous functions on 
El X E 2 and define the operator Ai : Dom(^) — >■ C{Ei x i? 2 ,R) for all / G Dom(^), all x G Ei, and all y G E 2 

by 


{Aif)ix,y) :=^ly^>oi KH^[rn{iJ)^{xj-Xi)^ -aXi{l-Xi) 

i&T) \ 7GI> 


■ 


For all / G Dom(^), all G N, and all t G [0, 00 ) dehne 

W ■■=^ f (-4i/) du-J2 f &Mu) 


J) {Fuii) - Fuii)) TJ^ 


j€-D 


- (1 - F„^(*)) 


+ ) - WTWIT) - 


From Ito’s lemma and Lemma [2^ we get for all / G Dom(yl), all G N, and all t G [0, 00) that P-a.s. 

/ (F,") - 1 (Fo~) = E r il-fr")+ I E /' {AirSFT)y{F^ii),F'^{i))^ 


= E/ 


1615 ‘ 


rn{hj) {FuU) - Fui^)) Fu (i) (l “ F^{i)) 


iGX> 


(119) 


( 120 ) 


( 121 ) 


iGX >-^0 

Hence, we get for all / G Dom(^), all At G N, and all t G [ 0 , 00) that P-a.s. 

/ {F,l) - f (Aif) {F^^, du + e^{tN) 

JO 

= /W) + E f S:(f:.)J 

From Tonelli’s theorem and Lemma we obtain for all / G Dom(^), all At G N, and all t G [0,oo) that 

-\ 2 


( 122 ) 


E 


Kiev 

< max — sup sup E 

ieVf MeNuefo.oo) 


du 


< max sup sup E 

*6^^/ MGN«g[0 , 00 ) 


(i) 


(123) 


1 



cr- 


< 00. 


Thus for all / G Dom(^), all At G N, and all t G [0,oo) the left-hand side of (11221) is a martingale. Next, for all 
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/ G Dom(yl) and all T G [0, oo) it holds that 


sup E 

NGN 


= sup E 

NGN 


(A^f) dt 

iGVf \ jGV ‘ 

„.jpN TpN t^W 1 df f zpN \ I 1 \ ' a -f^tN(®)(l“-FtN(®)) d^/ / \ 

(1 - ^tNW) I dTi \^tN) + 2 2 ^ PH - H^) - 


iGT>f 


dt 


< supE 

AfGN 


- 1 


+ 

acf 

+ 


)) 

\iGVf \ 

jGV 





// J 


( 124 ) 


Using Young’s inequality and Jensen’s inequality we get for all / G Dom(yl) and all T G [0, oo) that 


sup E 

NGN 


\{AJ) dt 


< sup E 

N£N 


< supE 

NGN 


E l( 




NG-Df 


^ +acf + ^PHjY^Cf 

jev / 

[ Y <’•((!)*(»»-=/h^)‘ + (1)*( Y-»(.-d)ff,'t(i))‘ 

iG-Df \ 

4 4 \ 

+ (ac/) ' + (hPHH^ff) jdt . 


jGV 


dt 

(125) 


Using Lemma [231 Tonelli’s theorem, and Lemmas 12.51 and |2.61 we obtain for all / G Dom(^) and all T G [0, oo) 
that 


sup E 

NGN 



(Aif) {F,1 ,H,^n) 


4 

3 


dt 


< sup 
ngn 


(4|P.fl)^ 

minfcgx>^{o’fc} 



(l)' 


E 





+ (ac/)3 lllll^ 


+ 




dt < oo. 


(126) 


Furthermore, for all / G Dom(^), all iV G N, and all T G [0,oo) we have that 


E 

sup 



iG[ 0 ,T] 



= E 


sup 

iG[ 0 .T] 



dx. \^uN) 




X™(bj) {fNU) 

jGV 


FNi^)) 


E^nUI 


+ {a- Na^) FN{i) (l - FNi^)) ] + hU^F^) {Ph - du 


< E 


E»/( 


iGVf 


kh - Nk^\ X j) gw"(,] + \a- Na^\ + ^\Ph- du 

jev 
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Using Young’s inequality, Lemma [2.41 and Tonelli’s theorem we get for all / G Dom(yl), all iV G N, and all 
T G [0, oo) that 


E 


sup 

tG[0,T] 




< E 


\kh-Nk^\ 




y ^ 

/ ^ mi 

+ U_jVa^| + |fa-yg| 1 




N 

uN 




du 


g.f 


— minfcgx'f {cTfc} 


kh-ATk" 


+ la — Na^\ ||].||cr + 


E 




cE 


if' 


iGX> 




du. 


Hence, from Lemmas 12.51 and 12.61 we see for all / G Dom(^) and all T G [0,oo) that 


0 < lim E 

N —¥00 


< lim 


sup 

efm 

t^[0,T] 



(128) 


Tcf 


Uff — ATk;^ 


N—^oo ““fee®/{‘’'fcl 

\dH-Nf3S 


2 sup sup ( E 

MGNie[0,oo) ' 


2 sup sup E 
mgn te[o.oo) 




= 0 . 


+ cE 


(iLf)" 1)+|a_AraA^|||l||^ (129) 

(tJ / 


Define the set TZ := \ X Bi '. {Bi)i^xi C H([0, oo)^), i?i = [0,oo) for all but finitely many i G d}. For 

I iGX> I 


all 


TV G N, alH G [0, oo), and all H G 7?. define the measure-valued random variables 


A^([0,t] X B) := f 1 b du = f 1 b. du, 

Jo Jo jgBi 


( 130 ) 


Due to Caratheodory’s theorem (see e.g.. Theorem 1.41 in Klenke [TH]) there is a unique extension of this 
pre-measure to a measure on [0,t] x E 2 , which we will denote by the same name. Define the space £{£ 2 ) '■= 
{it: is a measure on [0, 00) x E 2 such that for all t G [0,oo) it holds that fi{[0,t] x E 2 ) = t} and the space 

D([0,oo)) := {/: [0,oo) —>■ iTil/is cadlag}. Having checked all assumptions, we can now apply Theorem 
2.1 from Kurtz [21] and conclude that the sequence {{{FtN)t£[o 00 )^^^) ^ G N} is relatively compact 
in D([0,oo)) X £{E 2 ). Let {E,K) be a D([0,oo)) x £(£’ 2 )-valued random variable and let (TVfe)j,gj^ C N be an 
increasing sequence such that limfe_..oo ((yv),)tg[o 00 )’ ~ Skorohod’s representation theorem 

(see Theorem 3.1.8 of Ethier and Kurtz H) we can assume without loss of generality and for ease of notation 
that (E, A) acts on the probability space (D, P). Using Holder’s inequality and Theorem 11.21 we see for all 

t G [0, 00) that 


0 < lim / E 

N —^00 /n 


- {ho. (y^(^))) 


iex> 


du = lim / E 

Af->oo In 




.iGl> 


du 


< lim 
N—¥oo 


\ 


E 


.i£T> 


(131) 


du t y CTfc = 0. 


feGC 


For any bounded Lipschitz continuous function /:!),—>■]&, with Lipschitz constant c/, and all t G [ 0 , 00), 
applying (I131F we then have 


0 < E 


f{y)A{dux dy) - /(hoo(Fix)) dw 


0 E 2 


= lim E 

fe—>-oo 


/ f{HX)du- ! f{hXFX))dn 

Jo Jo 


(132) 


< c/ 


lim E 

k—^oc 


'-Jo 




= 0 . 
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Define the operator A 2 '■ Dom(^) —>• C(Ei, R) for all / G Dom(^) and all x € Ei hy 



+ Xi)x^(l -Xi)j^(x). 

2GT> 


For all t € [0, oo)^ all / G Dom(^), and all x G Ei we have P-a.s. 


[ f iAif)iFs,y)A{ds X dy) 
«/ 0 J E 2 


.iev \ jeT> 




iev 


Yi'^Viib-ooiEsii))) dyds = f {A 2 f){Fs)ds. 


. iev 


( 133 ) 


(134) 


Applying Theorem 2.1 of Kurtz m together with (11341) . we see for each / G Dom(A) that 

(/(«)-/M2/)(-f’-)*),s[.,=oi 


( 135 ) 


is a martingale. Hence, A is a solution to Note that for all zi,Z 2 G [0,1] we have that f 3 fj(z 2 — zi) = 
(a — Zi)(| 5 f 7 ~ !)• Using this and (O we then have for any subset S CD and any x,y € E 2 that 


^m(i, - {a - Xi) - + (“ “ yi)) ~ «(*»(! - ^i) - - 2/*))) 

*es iGi> 

= (i^H Y Hhj)i{xi - yi) + {{a - Xif - (a - yif)^ -(a- y^f(G^ - G^)) 

ieS jeT> 


+ a(-(xi - yi) + x} - yl)'^ 

<Y‘^^{'^h Y j)lx,>y,(a - yi)‘^{-yG- - T^)) + 2a)l^,>yXxi - Vi) 

ieS jeT> ieS 

< - yj)'^ +^cr*(K// + 2 a)l^,>y^ixi - yi) 

i&S i£S 


< Y'^EKH'i-Xi>yi^-(^ZTjG + ‘2a)lxi>yi{Xi 

ieS i£S 


Vi) =Y^^( (a-iy + {Xi-yi)^. 

ieS 


(136) 


This implies that equation (26) of Hutzenthaler and Wakolbinger m is fulfilled. Together with the assumptions 
on m in Assumption II . II we now infer, analogous to Proposition 2.1 of Hutzenthaler and Wakolbinger [T7], that 
the system ([5]) has a unique strong solution with a.s. continuous paths. We conclude that any limit point of 
{ : TV G N} solves ([S]). Combining this with the fact that { {FtN)te[o oo) ^ A^ S N} is relatively 

compact we obtain => (^ 4 )^^^^ as TV —>• 00 . This finishes the proof of Theorem 11.31 □ 


3 McKean-Vlasov limit 

In this section we investigate convergence of a sequence of exchangeable systems of stochastic differential equa¬ 
tions. 
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3.1 Setting 

Let (O, J", P) be a probability space, let I C [0, oo) be an interval of length |J| G (0,oo] which is either of 
the form [0, |/|] if |/| < oo or of the form [0,oo) if |/| = oo, let ^ C R be a convex set, and let tjj' I A, 
Ax I and : I ^ [0,oo) be functions. The function : I ^ [0, oo) is locally Lipschitz continuous 

in I and satisfies (7^(0) = 0 and if |/| < oo, then cr^(|/|) = 0. Furthermore, the function is strictly positive 
on (0, |/|). There exists a constant L G (0,oo) such that satisfies the growth condition that for all y G / we 
have cr'^iy) < L{y + and such that ^ satisfies for all {u, x), (v, y) € A x I that 

lx>y(C('u,a;) - ^(v,y)) < L{u - ?;)+ + L{x - y)+. (137) 

The function ■)/):/—>• [0, oo) satisfies for all x,y G I that |^(x) — ipiy)\ < ~ 2/1- Let W{i): [0, oo) x 12 —>• R, 

i G N, be independent Brownian motions with continuous sample paths. For all G N let : [0, oo) x 
{1,..., D} X 12 — >■ J be an adapted stochastic process with continuous sample paths that for all t G [0, oo) and 
alH G {1, ..., D} P-a.s. satisfies 

X,^(*)=Xo^(*)+ ^ V^(xf(j)),Xf(*))ds+ (138) 

Let M: [0, oo) x 12 —^ / be an adapted stochastic process with continuous sample paths that for alH G [0,oo) 
P-a.s. satisfies 

aEmM,)],Ms)ds+ f 
Jo 




(139) 



3.2 McKean-Vlasov limit 


The following proposition. Proposition 13.11 partly generalizes Proposition 4.29 in Hutzenthaler |16| where ^ 
depends linearly on its first argument. 


Proposition 3.1. Assume the setting of Seetion AS. 11 let AIq be an I-valued random variable, for every Zl G N 
let (^(f*(j))jg ^2 D} exchangeable and integrahle random variables with values in I. Then, there exists a 
unique solution M of (11391) and for all D G N and all t G [0,oo) we have that 


/de 


\X^{1)-Mt\ (^/DE |Xo^(l)-Mo| L (Var (^(M«))). (140) 


Proof. Existence of a weak solution is straightforward using a tightness argument. Next we show pathwise 
uniqueness for the SDE (11391) . Let XI, M: [0,oo) x 12 —>■ I be two solutions of the SDE (I139D . Then our 
assumptions and a standard Yamada-Watanabe argument (cf., e.g.. Theorem 1 in Yamada and Watanabe [12]) 
shows for all t G [0,oo) that P-a.s. 


\Mt - Mt\ = |Mo - Mol + [ sgn(M« - M,)d(M, - M,). (141) 

Jo 

Let (Ti);gi!} be a localizing sequence for the local martingale (fg sgn(Ms — Ms){a^{XIs) — a^{Ms)) 

Then Eaton’s Lemma and our assumptions imply for all t G [0,oo) that 


E[\Mt - Mt\] < lim E[|Mt;,,, - M^nl] 

l—^OO 


< E[\Mo 

< E[\Mo 


Mo|]+E 

Mo|]+L 



sgn(M« - Ms){ani’{Ms)],Ms) - e(E[V'(Ms)],M,)) ds 
E[^(M«)] - E[V^(M,)]| +E[|M, - M,|] ds 


(142) 


< E[|Mo - Mol] + (L + 1)" [ E[|M, - M,|] ds. 

Jo 

This together with Gronwall’s lemma implies pathwise uniqueness for the SDE (11391) . Therefore, the theorem 
of Yamada and Watanabe (see Yamada and Watanabe [12]) implies that the SDE (11391) is exact. The rest of 
the proof is analogous to the proof of Proposition 4.29 in Hutzenthaler m and we omit it here. □ 
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3.3 Application to altruistic defense in structured populations 

In this section we verify the applicability of Proposition 13.11 to the case of altruistic defense in structured 
populations. 

Lemma 3.2. Let a,/3, k G (0, c») and a £ (l,c»), let I = [0,1] define the function : I ^ [0,oo) by 
/ 9 a; I—>■ cr^(a;) := /3(a — a:)a;(l — x), the function ip: I ^ [0, oo) by I B x := and the function 

^: [0, oo) X / —?► R [0, oo) x / 9 (m, x) i-9 ^{u, x) := K(a — x) ((a — x)u — l) — ax(l — x). Then the interval I 

and the functions , ip, and ^ satisfy the setting of Section \3.1\ with L = max {/3a, Ka^, k + a, } • 

Proof. For all {u,x), {v,y) £ [0,oo) x [0,1] it holds that 

la:>y(^(a,x) - ^{v,y)) 

= lx>y{K{a - x){{a - x)u - 1 ) - K(a - y)((a - y)v - 1 ) - ax(l - x) + ay{l - y)) 

= lx>y(K[(a - xYu - (a - x) - (a - y^v + (a - y)] - «(! - (x + y)){x - y)) (143) 

= lx>y{n[{x -y) + ((a - xf - (a- yf‘)u - (a - yfiy - u)] - a(l - (x + y)){x - y)) 

< (k + a)(x — y)~^ + Ka?(u — x)'*' < L(x — y)'^ + L{u — x)''“. 

Moreover, for all x, y £ / it holds that (t^(x) = j3{a — x)x(l — x) < fax < L{x + x^) and that 

\'iP{x)-P;{y)\ = \^-^\ = \ j j^dz\<j^\x-y\<L\x-y\. (144) 

Jy 

This finishes the proof of Lemma [3^ □ 


4 Long-term behavior of the average altruist frequency 

4.1 Setting 

Let (n,J^, P) be a probability space, let K,a,f £ (0, oo), a £ (l,oo), c £ (0,1), let W: [0,oo) x 11 —>• R be a 
Brownian motion with continuous sample paths, let Z: [0, oo) x 11 —> [0,1] be an adapted process with continuous 
sample paths that for all t £ [0, oo) satisfies P-a.s. 

Zt = Zo+ [ {K{a-Zs){{a-Zs)E[^]-l)-aZs{l-Zs))ds+ [ f{a - Zs)Zsil - Zs) dWs- (145) 
Jo ” Jo 

Moreover, for all d £ (i, ^^) let Z^: [0, oo) x H —>• [0,1] be an adapted process with continuous sample paths 
that for all t £ [0, oo) satisfies P-a.s. 

Zf = Z^, + f {k {a - Zt) {{a - Zf) 6-1)- aZ^ (l - Zf)) ds + f J/3 (a - Z«) Zf (1 - Zf) dWs- (146) 

Jo Jo 

For all 0 £ (i, and all 2 £ [0,1] define 


me{z) :=/3c^^“'^-^J(l - - c)^-F exp 

=z^(“®”i)"i(l - - z)^~\ 


1 K,{a-y){{a-y)e-l)-ay(l-y) 
' /3(a-y)y(l-y) 


dy 


(147) 


Note that this defines the speed density (see p. 95 in Karlin and Taylor [18]) for (|146l) . Furthermore, note that 
for all 0 £ (i, it holds that 

\ a ’a—1/ 


/ mg{z)dz < oo. 
Jo 


(148) 
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For all 9 G (i, define cg := mg{z)dz, for all x G {0,1} denote by the Dirac measure on [0,1], and for 
all 9 G [i, define the mapping 'hg : yB([0,1]) —>■ [0,1] by 


S([0,l])9 := 


<5o(A), 

Si{A), 


jA^^e(z)dz, 


if 0 = i, 
if 0= 

a—1 ’ 

if0g 

\a’a—1 } 


(149) 


4.2 Results for the equilibrium distribution 

Assume the setting of Section 14.11 Existence and uniqueness of the solution of (I145|) follow from Proposition 
o When 0 G (i, we have that 'I'g defines a probability distribution by (11481) . and we can apply Theorem 
V.54.5 of Rogers and Williams m to conclude that it is the unique equilibrium distribution for (11461) . The 
proof of the following lemma, Lemma 14.11 is clear and therefore omitted. 

Lemma 4.1. Assume the setting of Section \4-.l\ A probability measure $: ;B([0, 1]) —>• [0,1] is an equilibrium 
distribution of the dynamics (|145|) if and only if there exists a 9 £ [i, such that = 4*0. 

Lemma 4.2. Assume the setting of Section ED and let 9 G (i, Then we have 



<9, if a > P, 
= 9, ifa = P, 
>9, if a < p. 


(150) 


Proof. Define u := ^{a9— 1) and v := ^(1 — 9{a— 1)) and note that u,v G (0,oo). Let T: (0,oo) —(0,oo) be 
the Gamma function, i.e., for all x G (0, oo) let r(a;) := z^~^e~^ dz. It is well-known that for all x G (0, oo) 

the Gamma function satisfies r(a;-|- 1) = a:r(a;) and that for all x,y £ (0, oo) it holds that z““^(l — z)^~^ dz = 
■ Thus, we obtain 


j\-\l-zr-\a-z) (^-0) dz 

= [ z'^-^il-zf-^ dz-a9 [ z^-^{l-zf-^ dzP9 [ z^^l-zf-^dz 
Jo Jo Jo 

_ r{u)r{v) _ n r(u)r(v) ^ r(^-n)r(^) _ G, _ («+£)r(«)rM , f) ur{u)r{v) \ 

— r(u+t;) r{u+v) ■'■"r(u+D+i) “G “'^1 r(u-i-ij-i-i) '^^t(u+v+i)) 

= (u(l -a9 + 9)+ 7;(1 - a9)) ^ ((a0 - 1)(1 - 0(a - 1)) + {1 - 9{a - 1))(1 - a0)) 

= (f (1 - 9{a - l))(a0 - 1 + 1 - a0)) = 0. 

First, consider the case a = p. Using (USD we see that 

i;h'^s{dz)-9 = (^-0) 

^ z“"i(l - zy-^{a - z) - 0) dz = 0. 


(151) 


-9] dz 


'0 

= ce 


(152) 


Now, consider the case a > p. Let S := a — P, S and z* := sup{z G (0,1) : — 0 < 0}. Note that 

(5, (5 > 0 and z* = a — | G (0,1). Also note that for all ^ G (0, z*) we have — 0 < 0 and (a — z)^ > {a — z*Y. 
Furthermore, for all z G (z*, 1) we have — 9 > 0 and (a — z)^ < (a — z*)^. Together with (11511) we thereby 
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obtain 


^ 7;^'^eidz)-0 = = ^(1-^)" \a-z)^ ^ {-^ - ^) ^z 

= cez^-\l - zr-\a - z)^+^ (^ - o) dz + cez“-'(l - zy-^a - zy+^ (^ - o) dz 
<ce{a- z*y(^j^ - 2 ;)“"i(a-z) - 6 ») dz + z^-\l - zy-^a - z) (^-^ - 6^ d^ 

= ce{a - z*y j - zy~'^{a - z) -9^ dz = 0 . 

The case a < (3 can be proved analogously and thereby, we omit it here. This finishes the proof. 


(153) 


□ 


4.3 Proof of Theorem 11.41 

Proof of Theorem [13 Applying Ito’s lemma, we get for all t G [0,oo) that 

a-Zo ~ [ {a-ZsY ~ ~ Zs)E 

^ 0 


1—Zt 


- 1 -azyi-z, 


+ Zs)Zs{l-zyds + j - Z^Z^l - Z,) dW, 

t 


(154) 


I ^ (e [a] - a) - ^ + 1 x;i^VPia-zyzyi-zydWs. 


After taking expectations we can apply Fubini’s theorem to obtain for alH £ [0,oo) that 




a—Zo 


/“(* 


a—Z. 

-t 


-E 


O Z s 


— aE 


Zs p — Zs) 
(a-Zs)'^ 


■/3E 


^s{^ — Zs) 

(o-z,)" 


ds 


(155) 


= {P-a) E 


Zs{l — Zs) 

(a-Zsy 


ds. 


Jo 

Since for all s G [0,oo) it holds that E[ ] > 0 we conclude that the function [0,oo) 9 t E[ ^_^^J G 

[i, converges monotonically non-increasing as t —> oo if a > /3, monotonically non-decreasing if a < /3, or 
is constant if a = 13. 

First, assume a > ( 3 . From (11451) we see that ( 5 i is an invariant measure for Z . So if TP[Zo = 1] = 1, then 
for all t G [0,oo) it holds that V[Zt = 1] = 1. Now let ¥[Zq = 1] < 1, implying E ^Jzo ^ [a’T^)- Define 
9 := lim E[3^] E^nd fix it for the rest of the paragraph. Note that due to the monotonicity stated above we 

have 9 G [i, 7 ^). Aiming at a contradiction, we assume that 9 G (i, ^ 7 ^)- Choose any e G (0, 77 ^ — 9) and 
fix it for the rest of the proof. By definition of 9 there exists an G (0,oo), such that for all t G [s£,oo) it 
holds that E [ ] < 9 + s. Let IF: [0, 00 ) x O —>■ R be a Brownian motion with continuous sample paths, let 

Z: [0, 00 ) X O —)► [0,1] and [0, 00 ) x 11 —>• [0,1] be adapted processes with continuous sample paths that 

satisfy for all t G [0, 00 ) P-a.s. 


Zt — Zn 


^K(a - Zs) (^{a - ^s)E 


a—Zs 


- 1 ) - aZsil - Zs)) ds 


+ yp{a-Zs)Zs{l-Zs)dWs, 




_ 7^+6 

— Zq 


+ £ (.^(a - zt+y ((a - zt+y {9 + £) -1) - azt+yi - z!+y) 


( 156 ) 


ds 


IJ' 


+ I y^(a - zt+yzt+yi - zt+y dWs, 


0 -|-£\ 
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such that = Zq and such that Zq and Z^^ are equal in distribution. Then for each t G [s^, oo) we have that 
Zt and Zt-s^ are equal in distribution and the drift term of Zt-s^ is lower than that of Together with 

the fact that the mapping [ 0 , 1 ] 9 z i—>■ is strictly monotonically increasing this implies for all t G [se,oo) 


that 


E 


1— Zt 


= E 


1 

^ IfT 

1 





(157) 


Recall from Section 0^ that for any V G ^ 7 ^) we have that is the unique equilibrium distribution of Z^. 
Combining this with (I157|) we obtain (see, e.g., Theorem V.54.5 in Rogers and Williams [34]) 





(158) 


The dominated convergence theorem yields that the mapping (i, 9 ?? 1 —t is continuous with respect to 

the weak topology. Applying this, (I158|) together with the fact that e: G (O, — 9) was arbitrarily chosen, and 

Lemma l4.21 we obtain the contradiction 


' ^ ^e+sidz) = ^ 'i'eidz) < 9. (159) 

do 

Hence, we have 9 = ^, implying 


< lim 
( 5->-0 


0 < lim E [Zt] < lim a^E 

t—^oo >-oo 


Zt 

a{a—Zt) 



(160) 


The case a < fd can be proved analogously and we omit it here. 

Finally, assume a = /?, define 9 := E[ ^_^^^ ], and fix it for the rest of the proof. We see from (11551) that 
E[ a-Zt ] constant in t G [0,oo). Thus, assuming that Zq and Z^ are equal in distribution we see from (11451) 
and (I146D that for all t G [0, 00 ) it holds that Zt and Zf are equal in distribution. Recall from Section that 
is the unique equilibrium distribution of Z^. Consequently, is the unique equilibrium distribution of Z. 
This finishes the proof of Theorem 11.41 □ 


5 Invasion of an altruistic defense allele 

5.1 Setting 

Let (H,J^,P) be a probability space, let K,a,/3 G (0,oo), a G (l,oo), and let W(i): [0, 00 ) x H R, f G N, be 
independent Brownian motions with continuous sample paths. For all H G N let : [0, 00 ) x {1, ..., D} x H —>■ 
[0, 1] be an adapted process with continuous sample paths that for all t G [0,oo) and all i G {1, . ■. ,D} P- 
a.s. satisfies 


Xt^ii) = X^ii) + j\a - Af (*)) (^{a - Af (z)) A ^ - l) - aX^m - (*)) ds 

+ £ ^//d{a-XD[t))xpm-Xp{^)) dWs (*). 

Let d: [0, 00 ) —>■ [0, 00 ) be a function defined by 

[0, 00 ) 9 a: d{x) := + {x - 1)+. 


(161) 


(162) 


Then, assuming there is positive mass only in deme 1, the dynamics in deme 1 follows asymptotically the 
following process Y. Let Y: [0, 00 ) x H ^ [0,1] be an adapted process with continuous sample paths such that 
for all t G [0, 00 ) it P-a.s. holds that 

^Ys{a-Ys) + aYsil-Ys)ds+ [ 

Jo 


^/fd{a-Ys)Ys{l-Ys)dWs{l). (163) 
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In addition, let Qy be the excursion measure which satisfies Qy = limo<£_>.o G -IFo = £] in a suitable 

sense; see Pitman and Yor |29| and Hutzenthaler |15j for details. Asymptotically in the many-demes limit, every 
deme with population path x G C([0, oo), [0,1]) populates demes through migration and these new populations 
are given by a Poisson point process with intensity measure d{xt)dt x (dip). Now let (Vt)jg[o_oo) be the total 
mass process of the associated tree of excursions with initial island measure that equals the distribution of Y 
in (Umi) and excursion measure Qy. 


5.2 Survival or extinction of an invading altruistic defense allele 

Proposition 5.1. Assume the setting of Section \5.1[ Let x G (0,1] and assume Yq = x = Vfj. Then the total 
mass process dies out (i.e., converges in probability to zero as t ^ oo) if and only if 


a> (3. 


(164) 


Proof. Define the functions s: [0,1] —>■ [0, oo) and S\ [0,1] —>■ [0, oo) by [0,1] ^ z s(z) := exp ^ — 
/p P’ 1] 3 y S{y) := s(z) dz. Note that for all z G [0,1] it holds that 


and 


W = + f = (1 - ' 

S{z) = / s{x) dx < zs{z). 

Jo 


(165) 


(166) 


We will apply Theorem 5 from Hutzenthaler |15j to show the result. First, we verify that the assumptions of 
the aforementioned theorem are satisfied. Using (11661) . we see that 


^(y) P{a-y)y'(l-v)s{y) ^ /3(a-yKl-y) ^ 2/3(a-iKl-i) < 


(167) 


Furthermore, we get 

-■^(Q-y)y-ay(i-y) 


lim 

S —^0 


i/3(a-y)y(l-y) / aP(l-y) P{a-y) 

6 

= Im (if (ln(l - 5) - ln(l - e)) + ^(ln(a - f) - ln(a - e))) 
= If “ 1 ) + 1 ) ^ (- 00 , 00 ). 


- 2 ^ _J 

a3(l-y) dia-y) 


(168) 


From (I165p as well as the fact that if > 0 we see that 


a(y) 


2 h{a—y)y(l-y)s(y) 


dy = 


^h(a-y)y{l-y) 


(l-y)i^(^tt^Ydy 


= 2!fa~^ 

(l-y)“3 \a 


1)^-2 + (, 


(169) 


We obtain from (I167L (]168p . and (11691) together with a straightforward adaptation of Lemmas 9.6, 9.9, and 
9.10 in Hutzenthaler [IS] to the state space [0,1] that the assumptions of Theorem 5 in Hutzenthaler [IS] are 
satisfied. Applying the aforementioned theorem shows that the total mass process dies out if and only if 

d(xt)dtQY(dx) <3. (170) 
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Moreover, a straight forward adaptation of Lemma 9.8 in Hutzenthaler [15] to the state space [0,1] together 
with (165) shows that 


r poo pi y . 2^ 

J X ~^(.Xt)dtQy{dx)= ' dy. 


(171) 


Observe that we have /o^(l ~ 2/)^ ^ dy = 1. Combining this with (117011 and (117111 we see that the total mass 
process dies out if and only if 




-1 


2k 

a0 


P 1 2q _o / 2a _a \ 


(172) 


Consequently, the total mass process dies out if and only ii a> f3. This finishes the proof of ProDOsition l5.ll □ 
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